INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, AND INFORMATION PROCESSING METHOD

• US 20180259652A1
• Filed: 09/28/2017
• Published: 09/13/2018
• Est. Priority Date: 03/09/2017
• Status: Active Grant

• Current Assignee: Aerosense Inc.
• Original Assignee: Aerosense Inc.
• Inventors: SHIMIZU, Satoru, SABE, Kohtaro, MAESHIRO, Tomohiro, SUZUKI, Kousuke, MURAKOSHI, Sho
• Granted Patent: US 10,761,217 B2
• Time in Patent Office: Days
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 15/04 Permanent marks; Boundary markers
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 19/10 providing dedicated supplementary positioning signals
• CPC Class Codes: G01S 19/45 by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement
• CPC Class Codes: G01S 19/485 whereby the further system is an optical system or imaging system
• CPC Class Codes: G01S 7/4972 Alignment of sensor
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/17 taken from planes or by drones

Abstract

There is provided an information processing system including: a plurality of survey markers each including a GNSS reception unit that receives a signal from a GNSS satellite; a first position measurement unit that measures a ground position of at least one survey marker on the basis of the signals received by the plurality of survey markers; and a processing unit that detects the survey marker from a captured image captured by a UAV and including the survey marker, and associates a position of the detected survey marker in the captured image with the ground position.

Claims

1. An information processing system comprising:

a plurality of survey markers each including a GNSS reception unit that receives a signal from a GNSS satellite;

a first position measurement unit that measures a ground position of at least one survey marker on the basis of the signals received by the plurality of survey markers; and

a processing unit that detects the survey marker from a captured image captured by a UAV and including the survey marker, and associates a position of the detected survey marker in the captured image with the ground position.

2. The information processing system according to claim 1, wherein the first position measurement unit is included in a processing device different from the survey marker, and measures the ground position by an interferometric positioning method.

3. The information processing system according to claim 2, wherein the first position measurement unit measures the ground position by a static method.

4. The information processing system according to claim 3, further comprising

a notification unit that issues a notification that a predetermined time has elapsed from a start of reception of the signal.

5. The information processing system according to claim 2, wherein the first position measurement unit measures the ground position by an RTK method.

6. The information processing system according to claim 5, wherein the first position measurement unit is included in the survey marker.

7. The information processing system according to claim 1, wherein the captured image including the survey marker is a captured image captured by the UAV when the GNSS reception unit of the survey marker is receiving the signal.

8. The information processing system according to claim 1, further comprising

a second position measurement unit that measures a second ground position of the survey marker by a point positioning method on the basis of the signal.

9. The information processing system according to claim 8, wherein the second position measurement unit is included in the survey marker.

10. The information processing system according to claim 8, further comprising

an information processing terminal,

wherein the information processing terminal includes

a second reception unit that receives information on the second ground position, and

a display control unit that controls display of the information on the second ground position.

11. The information processing system according to claim 10, wherein the information processing terminal further includes a flight path generation unit that generates a flight path of a UAV that aerially photographs the survey marker, on the basis of the second ground position.

12. The information processing system according to claim 10, wherein

the second reception unit also receives information on the signal, and

the display control unit also controls display of the information on the signal.

13. The information processing system according to claim 1, wherein the GNSS reception unit is provided at substantially the center of the survey marker.

14. The information processing system according to claim 1, wherein the GNSS reception unit is provided to be separable from the survey marker.

15. The information processing system according to claim 1, wherein the survey marker has a shape in which a plurality of circles having different radii are placed concentrically, and hues corresponding to colors of adjacent circles differ by a predetermined threshold or more, or one of the colors is black.

16. The information processing system according to claim 1, wherein the processing unit generates 3D model data of the ground on the basis of information in which the position of the detected survey marker in the captured image is associated with the ground position.

17. An information processing device comprising:

a first position measurement unit that measures, on the basis of each of signals from a GNSS satellite received by a plurality of survey markers, a ground position of at least one survey marker; and

a processing unit that detects the survey marker from a captured image captured by a UAV and including the survey marker, and associates a position of the detected survey marker in the captured image with the ground position.

18. An information processing method comprising:

measuring, on the basis of each of signals from a GNSS satellite received by a plurality of survey markers, a ground position of at least one survey marker; and

detecting the survey marker from a captured image captured by a UAV and including the survey marker, and associating a position of the detected survey marker in the captured image with the ground position.

19. An information processing system comprising:

a plurality of survey markers each including a GNSS reception unit that receives a signal from a GNSS satellite;

a first position measurement unit that measures a ground position of at least one survey marker on the basis of the signals received by the plurality of survey markers; and

a processing unit that detects a point corresponding to the survey marker from point cloud data corresponding to reflection points of laser light, and associates the point with the ground position, the point cloud data being generated by applying a plurality of beams of laser light and detecting reflected light reflected off the ground surface by a laser sensor included in a UAV.

20. The information processing system according to claim 19, wherein

a top face of the survey marker is made of a material having laser reflectivity corresponding to detection of a survey marker using the laser light, and

the processing unit detects the point corresponding to the survey marker from the point cloud data on the basis of output at the time of detecting the reflected light.