Course profiling and sharing

• US 10,540,746 B2
• Filed: 07/30/2019
• Issued: 01/21/2020
• Est. Priority Date: 09/30/2016
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Taylor, Michael, Castleman, Dennis Dale
• Primary Examiner(s): Osinski, Michael S
• Application Number:
  US16/526,819
• Publication Number:
  US 20190355092A1
• Time in Patent Office: 175 Days
• CPC Class Codes: G05D 1/102 specially adapted for vertical take-off of aircraft
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 2207/10032 Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

Systems and methods for unmanned aerial vehicle (UAV) course profiling are provided. A plurality of images may be captured by a UAV flying along a course at a first location. A profile may be constructed for the course based on the images captured by the UAV. The constructed course profile is transmitted over a communication network to a virtual reality system at a second location. The virtual reality system may generate a virtual environment corresponding to the course based on the constructed course profile, and a second UAV at the second location may fly along the virtual course.

Claims

1. A system for UAV-based space profiling, the system comprising:

an unmanned aerial vehicle (UAV) that includes a sensor that captures data regarding a physical space at a first location;

a processor that executes instructions stored in memory, wherein execution of the instructions by the processor;

constructs a profile for the physical space based on the data captured by the UAV, and

adds one or more virtual elements to the constructed profile; and

a network interface that transmits the constructed profile over a communication network to a virtual reality system at a second location, wherein the virtual reality system generates a virtual environment corresponding to the physical space based on the constructed profile, the virtual environment including the virtual elements specified by the constructed profile.

2. The system of claim 1, wherein the captured data includes one or more images of the physical space, and wherein the sensor comprises at least one mounted camera that captures the images while the UAV is flying through the physical space.

3. The system of claim 1, wherein the processor adds the virtual elements to the constructed profile by identifying one or more physical feature of the physical space, and generating the virtual elements based on the identified physical features.

4. The system of claim 1, wherein a physical space at the second location has different dimensions than the physical space at the first location, and wherein the virtual reality system generates the virtual environment based on a scaled version of the constructed profile, the version scaled based on the different dimensions of the second location.

5. The system of claim 1, wherein a UAV at the second location has different dimensions than the UAV at the first location, and wherein the virtual reality system generates the virtual environment based on a scaled version of the constructed profile, the version scaled based on the different dimensions of the UAV at the second location.

6. The system of claim 1, further comprising a server accessible over the communication network, wherein the network interface further transmits the constructed profile over the communication network to the server.

7. The system of claim 6, wherein the server hosts a session with a plurality of virtual reality systems, each virtual reality system generating a corresponding virtual environment corresponding to the physical space at a different location based on the constructed profile.

8. The system of claim 7, wherein each virtual reality system at a respective location further:

receives real-time information from each other virtual reality system regarding a corresponding UAV;

incorporates a representation of each corresponding UAV in the generated virtual environment at the respective location; and

adjusts at least one of the virtual elements within the generated virtual reality environment based on interactions between a UAV at the respective location and the representations of UAVs corresponding to each other virtual reality system.

9. A method for UAV-based space profiling, the method comprising:

capturing data regarding a physical space at a first location via a sensor on a UAV;

executing instructions stored in memory, wherein execution of the instructions by a processor;

constructs a profile for the physical space based on the data captured by the UAV, and

adds one or more virtual elements to the constructed profile; and

transmitting the constructed profile over a communication network to a virtual reality system at a second location, wherein the virtual reality system generates a virtual environment corresponding to the physical space based on the constructed profile, the virtual environment including the virtual elements specified by the constructed profile.

10. The method of claim 9, wherein capturing the data via the sensor includes capturing one or more images via at least one mounted camera while the UAV is flying through the physical space.

11. The method of claim 9, wherein adding the virtual elements to the constructed profile includes identifying one or more physical feature of the physical space, and generating the virtual elements based on the identified physical features.

12. The method of claim 9, wherein a physical space at the second location has different dimensions than the physical space at the first location, and wherein the virtual reality system generates the virtual environment based on a scaled version of the constructed profile, the version scaled based on the different dimensions of the second location.

13. The method of claim 9, wherein a UAV at the second location has different dimensions than the UAV at the first location, and wherein the virtual reality system generates the virtual environment based on a scaled version of the constructed profile, the version scaled based on the different dimensions of the UAV at the second location.

14. The method of claim 9, further comprising transmitting the constructed profile over the communication network to a server.

15. The method of claim 14, further comprising hosting a session via the server, wherein the session further includes a plurality of other virtual reality systems, each other virtual reality system generating a corresponding course at a different location based on the constructed course profile.

16. The method of claim 14, further comprising:

receiving real-time information from at least one other virtual reality system regarding a corresponding UAV;

incorporating a representation of each corresponding UAV in a generated virtual environment at the physical space; and

adjusting the generated virtual environment based on interactions between a UAV at the respective location and the representations of UAVs corresponding to each other virtual reality system.

17. A non-transitory computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for UAV-based course profiling, the method comprising:

capturing data regarding a physical space at a first location via a sensor on a UAV;

constructing a profile for the physical space based on the data captured by the UAV;

adding one or more virtual elements to the constructed profile; and

transmitting the constructed profile over a communication network to a virtual reality system at a second location, wherein the virtual reality system generates a virtual environment corresponding to the physical space based on the constructed profile, the virtual environment including the virtual elements specified by the constructed profile.

18. A system for UAV-based space profiling, the system comprising:

a network interface that communicates over a communication network to receive a constructed profile corresponding to a physical space at a remote location;

a processor that executes instructions stored in memory, wherein execution of the instructions by the processor scales the constructed profile for a local physical space, and

a virtual reality system at the local physical space, wherein the virtual reality system generates a virtual environment corresponding to the physical space at the remote location based on the scaled profile, the virtual environment including one or more virtual elements specified by the scaled profile.

19. The system of claim 18, further comprising a UAV at the local physical space that flies within the virtual environment and captures data while flying through the virtual environment.

20. The system of claim 18, wherein the network interface receives information regarding at least one other UAV at another remote location, and wherein the virtual reality system generates a virtual representation of the at least one other UAV within the virtual environment.