SYSTEM AND METHOD FOR AUTHORING AND VIEWING AUGMENTED REALITY CONTENT WITH A DRONE

• US 20190088025A1
• Filed: 09/14/2018
• Published: 03/21/2019
• Est. Priority Date: 09/15/2017
• Status: Abandoned Application

• Current Assignee: DroneBase, Inc.
• Original Assignee: DroneBase, Inc.
• Inventors: Tamanaha, Eli Yakushiji, Murphy, Michael David, Onorato, Michael James, Tafralian, Jared Peter
• Application Number:
  US16/132,144
• Publication Number:
  US 20190088025A1
• Time in Patent Office: Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/005 by providing the operator with signals other than visual, e.g. acoustic, haptic
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 5/00 Details of television systems scanning details or combination thereof with generation of supply voltages H04N3/00
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A display device receives video data, location data, position data from a remotely controlled unmanned aerial vehicle (UAV). The display device converts a first set of coordinates from the location and position data to a second set of coordinates of a virtual world model. A user of the display device provides a selection of an AR object at the display device that is also used to control the remotely controlled UAV. The display device associates the selected AR object with the second set of coordinates and providing information of the selected AR object and the second set of coordinates to a server.

Claims

1. A method comprising:

receiving video data, location data, position data from a remotely controlled unmanned aerial vehicle (UAV);

converting a first set of coordinates from the location and position data to a second set of coordinates of a virtual world model;

receiving a selection of an AR object at an AR display device used to control the remotely controlled UAV;

associating the selected AR object with the second set of coordinates; and

providing information of the selected AR object and the second set of coordinates to a server.

2. A method comprising:

receiving video data, location data, position data from a remotely controlled unmanned aerial vehicle (UAV);

converting a first set of coordinates from the location and position data to a second set of coordinates of a virtual world model;

retrieving information of an AR object associated with the second set of coordinates; and

displaying the AR object in a video feed from the UAV.

3. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving video data, location data, position data from a remotely controlled unmanned aerial vehicle (UAV);

converting a first set of coordinates from the location and position data to a second set of coordinates of a virtual world model;

receiving a selection of an AR object at an AR display device used to control the remotely controlled UAV;

associating the selected AR object with the second set of coordinates; and

providing information of the selected AR object and the second set of coordinates to a server.

4. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving video data, location data, position data from a remotely controlled unmanned aerial vehicle (UAV);

converting a first set of coordinates from the location and position data to a second set of coordinates of a virtual world model;

retrieving information of an AR object associated with the second set of coordinates; and

displaying the AR object in a video feed from the UAV.