Control device, control method, and computer program

• US 9,749,540 B2
• Filed: 03/27/2014
• Issued: 08/29/2017
• Est. Priority Date: 04/19/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sabe, Kohtaro, Kawanami, Yasunori, Kawamoto, Kenta, Sawada, Tsutomu, Shimizu, Satoru, Duerr, Peter, Yamamoto, Yuki
• Primary Examiner(s): Sosanya, Obafemi
• Application Number:
  US14/227,182
• Publication Number:
  US 20140313332A1
• Time in Patent Office: 1,251 Days
• CPC Class Codes: A63H 27/12 Helicopters A63H27/04 takes precedence; Flying tops
• CPC Class Codes: A63H 30/04 using wireless transmission
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

There is provided a control device including an image display unit configured to acquire, from a flying body, an image captured by an imaging device provided in the flying body and to display the image, and a flight instruction generation unit configured to generate a flight instruction for the flying body based on content of an operation performed with respect to the image captured by the imaging device and displayed by the image display unit.

Claims

1. A control device, comprising:

circuitry configured to;

acquire, from a flying body, a first image captured by an imaging device provided in the flying body, wherein the first image is displayed on a display;

generate a first flight instruction for the flying body, the first flight instruction instructs the flying body to capture a second image with a composition corresponding to a first operation with respect to the displayed first image; and

wherein one of;

the first flight instruction instructs the flying body to advance based on the first operation to enlarge the first image, or

the first flight instruction instructs the flying body to retreat based on the first operation to reduce the first image.

2. The control device according to claim 1, wherein the circuitry is further configured to generate a second flight instruction for the flying body so that a range designated in a second operation is positioned at a center of the second image.

3. The control device according to claim 1, wherein the circuitry is further configured to generate a second flight instruction for the flying body so that a range designated in a second operation is positioned in a position determined by a user in the second image.

4. The control device according to claim 1, wherein the circuitry is further configured to generate a second flight instruction for the flying body so that a range designated in a second operation have a size determined by a user in the second image.

5. The control device according to claim 1, wherein the circuitry is further configured to display a route of movement until the flying body is in a position to enable the imaging device to capture the second image.

6. The control device according to claim 1, wherein the first operation to enlarge the first image is a pinch operation to increase a distance between at least two fingers.

7. The control device according to claim 1, wherein the first operation to reduce the first image is a pinch operation to reduce a distance between at least two fingers.

8. The control device according to claim 1, wherein the circuitry is further configured to generate a second flight instruction to instruct the flying body to move in a horizontal direction, based on a second operation to slide the first image.

9. The control device according to claim 1, wherein the circuitry is further configured to generate, a second flight instruction to instruct the flying body to move so that a center of the second image is a designated position, based on a second operation to set the designated position as the center of the second image.

10. The control device according to claim 9, wherein the second operation to set the designated position as the center of the second image is a tapping operation.

11. The control device according to claim 1, wherein the circuitry is further configured to display a trace to a target position while the flying body moves based on the first flight instruction.

12. The control device according to claim 1, wherein the circuitry is further configured to superimpose a limit range, in which the flying body moves, on the first image.

13. A control method, comprising:

acquiring, from a flying body, a first image captured by an imaging device provided in the flying body;

displaying the first image on a display; and

generating a flight instruction for the flying body, the flight instruction instructing the flying body to capture a second image with a composition corresponding to an operation with respect to the displayed first image,

wherein one of;

the flight instruction is instructing the flying body to advance, based on the operation for enlarging the first image, or

the flight instruction is instructing the flying body to retreat, based on the operation for reducing the first image.

14. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, causes a computer to execute operations, the operations comprising:

acquiring, from a flying body, a first image captured by an imaging device provided in the flying body;

displaying the first image on a display; and

generating a flight instruction for the flying body, the flight instruction instructing the flying body to capture a second image with a composition corresponding to an operation with respect to the displayed first image; and

wherein one of;

the flight instruction is instructing the flying body to advance, based on the operation for enlarging the first image, or

the flight instruction is instructing the flying body to retreat, based on the operation for reducing the first image.