System and method for enabling virtual sightseeing using unmanned aerial vehicles

• US 10,140,874 B2
• Filed: 07/09/2015
• Issued: 11/27/2018
• Est. Priority Date: 07/31/2014
• Status: Active Grant

• Current Assignee: SZ DJI Technology Co., Ltd. (d/b/a DJI) (iFlight Technology Company Limited)
• Original Assignee: SZ DJI Technology Co., Ltd. (d/b/a DJI) (iFlight Technology Company Limited)
• Inventors: Yang, Kang, Liu, Ang, Zhou, Guyue, Gao, Mingming
• Primary Examiner(s): Smith, Jelani A
• Assistant Examiner(s): Wallace, Donald J
• Application Number:
  US14/795,652
• Publication Number:
  US 20160035224A1
• Time in Patent Office: 1,237 Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 2101/00 UAVs specially adapted for particular uses or applications
• CPC Class Codes: B64U 2101/20 for use as communications relays, e.g. high-altitude platforms
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 50/37 Charging when not in flight
• CPC Class Codes: G05D 1/104 involving a plurality of aircrafts, e.g. formation flying traffic control systems for aircraft G08G5/00
• CPC Class Codes: G06Q 10/04 Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" market predictions or forecasting for commercial activities G06Q30/0202
• CPC Class Codes: G08G 5/0043 Traffic management of multiple aircrafts from the ground G08G5/003 takes precedence; data processing specially designed for resource management, e.g. scheduling or allocating time, human or machine resources G06Q10/06
• CPC Class Codes: G08G 5/0069 specially adapted for an unmanned aircraft
• CPC Class Codes: G08G 5/0078 for monitoring traffic from the aircraft radar or analogous systems specially adapted for traffic control G01S13/91
• CPC Class Codes: H04B 7/18506 Communications with or from aircraft, i.e. aeronautical mobile service

Abstract

A system of virtual sightseeing using unmanned aerial vehicles (UAV) and methods of making and using same. The virtual sightseeing system can include a plurality of UAVs arranged over a geographical area of interest in one or more ground configurations. In response to a sightseeing request, one or more UAVs are activated and deployed to a sightseeing region of interest. The UAVs travel to the region of interest and, upon arriving, acquire data for presentation in real-time. The data can include both visual and non-visual data from the region of interest and can be presented in integrated fashion in a virtual reality terminal. The virtual sightseeing is supervised by an operational subsystem that is responsible for efficient allocation of UAVs in response to multiple sightseeing requests. Even if physically separate, the subsystems of the virtual sightseeing system can communicate via a data communication subsystem, such as a wireless network.

Claims

1. A method for operating unmanned aerial vehicle (UAV), comprising:

assigning a plurality of UAVs to station in a plurality of ground stations within a plurality of cells of a honeycomb UAV ground configuration covering an operational region, wherein a said cell in the honeycomb UAV ground configuration includes multiple said ground stations positioned in a miniature honeycomb pattern, each of the plurality of UAVs being assigned to station in at least one of the plurality of ground stations, and more UAVs being stationed in a first cell of high demand than in a second cell of low demand;

in response to an operating request and according to navigational information, redeploying at least one said UAV from the first cell to a region of interest within the second cell, and the operating request including operating settings, a location of the region of interest and a characteristic of the region of interest; and

acquiring data regarding the region of interest via the redeployed UAV.

2. The method of claim 1, wherein said redeploying includes:

receiving the operating request;

computing a UAV deployment request based on the navigational information and the operating request;

transmitting the UAV deployment request to the at least one said UAV; and

deploying the at least one said UAV to the region of interest in response to the UAV deployment request.

3. The method of claim 2, wherein said computing the UAV deployment request comprises:

selecting an idle UAV from the UAVs,

selecting a UAV nearest to the region of interest from the UAVs,

selecting a UAV from a predetermined group of the UAVs,

selecting one or more UAVs from the UAVs for deployment to the region of interest,

dynamically selecting one or more UAVs from the UAVs for deployment to the region of interest, or

a combination thereof.

4. The method of claim 2, wherein said transmitting the UAV deployment request comprises transmitting the UAV deployment request using a 3G wireless network, a 4G wireless network, a TCP/IP protocol, or a combination thereof.

5. The method of claim 1, further comprising:

transmitting the acquired data regarding the region of interest to a terminal; and

presenting the acquired data using the terminal.

6. The method of claim 5, wherein said transmitting the acquired data comprises transmitting the acquired data using a 3G wireless network, a 4G wireless network, a TCP/IP protocol, or a combination thereof.

7. The method of claim 5, wherein said presenting the acquired data comprises presenting the acquired data in a virtual reality terminal, presenting the acquired data visually, presenting the acquired data non-visually, presenting the acquired data in real-time, or a combination thereof.

8. The method of claim 1, wherein the at least one said UAV is equipped with a subscriber identity module (SIM) card for identifying the at least one said UAV over a wireless communication network.

9. The method of claim 1, further comprising dynamically deploying one or more replacement UAVs to the region of interest in response to an incapacity of the at least one said UAV.

10. The method of claim 1, further comprising reconfiguring the UAV ground configuration in response to one or more seasonal sightseeing needs within the operational region.

11. The method of claim 1, wherein said redeploying comprises selecting a predetermined UAV from the plurality of UAVs based on a power status of the predetermined UAV.

12. The method of claim 1, wherein said redeploying comprises selecting a predetermined UAV from the plurality of UAVs based on a maintenance status of the predetermined UAV.

13. The method of claim 1, wherein said redeploying comprises selecting a predetermined UAV from the plurality of UAVs based on an equipment status of the predetermined UAV.

14. The method of claim 1, wherein more than one of the ground stations are positioned within a single cell of the honeycomb ground station configuration.

15. The method of claim 1, further comprising:

transmitting the acquired data regarding the region of interest to a plurality of terminals; and

controlling the one of the UAVs by a single one of the plurality of terminals without input from other ones of the plurality of terminals.

16. The method of claim 1, wherein redeploying the at least one UAV to the region of interest includes redeploying at least one of the UAVs that is equipped with night vision to the region of interest according to the characteristic of the region of interest.

17. The method of claim 1, wherein the operating settings further include at least one of flight settings, camera settings, settings of a total duration for the data acquisition, or settings of a number of UAV'"'"'s to deploy.

18. The method of claim 1, wherein the first cell is adjacent to the second cell in the honeycomb UAV ground configuration.

19. The method of claim 1, wherein the redeployed UAV is selected from a plurality of idle UAVs that are assigned to station in one or more cells adjacent to the second cell in the honeycomb UAV ground configuration.

20. The method of claim 1, wherein different ones of the plurality of ground stations are equipped with different numbers of support systems depending on their distances to sightseeing hot spots.

21. The method of claim 20, wherein one of the plurality of ground stations that is located closer to one said sightseeing hot spot is equipped with more recharging stations for recharging the UAVs than another one of the plurality of ground stations that is farther away from the one said sightseeing hot spot.

22. A method for operating unmanned aerial vehicle (UAV) comprising:

assigning a plurality of UAVs to station in a plurality of ground stations within a plurality of cells of a honeycomb UAV ground configuration covering an operational region, wherein a said cell in the honeycomb UAV ground configuration includes multiple said ground stations positioned in a miniature honeycomb pattern, each of the plurality of UAVs being assigned to station in at least one of the plurality of ground stations, and more UAVs being stationed in a first cell of high demand than in a second cell of low demand;

receiving an operating request including operating settings, a location of a region of interest within the second cell, and a characteristic of the region of interest;

computing a UAV deployment request based on navigational information, the operating request, and a status of the UAVs;

transmitting the UAV deployment request to at least one said UAV assigned to station within the first cell;

redeploying the at least one said UAV from the first cell to the region of interest within the second cell in response to the UAV deployment request;

acquiring data regarding the region of interest via the redeployed UAV;

transmitting the acquired data regarding the region of interest to a terminal; and

presenting the acquired data using the terminal.

23. The method of claim 22, wherein the plurality of ground stations are arranged according to a honeycomb ground station configuration.

24. A method for operating unmanned aerial vehicle (UAV) comprising:

assigning a plurality of UAVs to station in a plurality of ground stations within a plurality of cells of a honeycomb UAV ground configuration covering an operational region, wherein a said cell in the honeycomb UAV ground configuration includes multiple said ground stations positioned in a miniature honeycomb pattern, each of the plurality of UAVs being assigned to station in at least one of the plurality of ground stations, and more UAVs being stationed in a first cell of high demand than in a second cell of low demand;

selecting, in response to an operating request and according to navigational information, at least one said UAV for redeploying from the first cell to a region of interest within the second cell, and the operating request including operating settings, a location of the region of interest and a characteristic of the region of interest;

redeploying the at least one said UAV to the region of interest;

acquiring encrypted data regarding the region of interest via the redeployed UAV;

transmitting the acquired data regarding the region of interest to a terminal; and

presenting the acquired data using the terminal.

25. A system for operating unmanned aerial vehicle (UAV), comprising:

a plurality of UAVs assigned to station in a plurality of ground stations within a plurality of cells of a honeycomb UAV ground configuration covering an operational region, wherein a said cell in the honeycomb UAV ground configuration includes multiple said ground stations positioned in a miniature honeycomb pattern, each of the plurality of UAVs being assigned to station in at least one of the plurality of ground stations, and more UAVs being stationed in a first cell of high demand than in a second cell of low demand; and

an operational subsystem for;

redeploying, in response to an operating request and according to navigational information, at least one said UAV from the first cell to a region of interest within the second cell, and the operating request including operating settings, a location of the region of interest and a characteristic of the region of interest, the at least one said UAV being for acquiring data regarding the region of interest,

wherein said operational subsystem is in communication with a terminal subsystem for inputting the operating request and presenting the acquired data regarding the region of interest.

26. The system of claim 25, wherein the at least one said UAV is equipped with an instrument for collecting image, video, sound, temperature, pressure, humidity, precipitation, wind speed, wind direction data, or a combination thereof regarding the region of interest.

27. The system of claim 25, wherein the terminal subsystem includes a virtual reality terminal for presenting visual and non-visual data acquired from the region of interest.

28. The system of claim 27, wherein said virtual reality terminal comprises:

a speaker for presenting sound data,

a heating/cooling element for presenting temperature data,

a humidifier/dehumidifier for presenting humidity data,

a sprinkler system for presenting precipitation data,

a ventilation system for presenting pressure, wind speed, wind direction data, or a combination thereof acquired from the region of interest, or

a combination thereof.