Information processing device, information processing method, program, and imaging system

• US 9,865,172 B2
• Filed: 03/04/2015
• Issued: 01/09/2018
• Est. Priority Date: 04/25/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Takahashi, Masahiro, Akagawa, Satoshi, Okazawa, Kae, Yamada, Yoshinori
• Primary Examiner(s): Lee, Tyler J
• Application Number:
  US15/122,608
• Publication Number:
  US 20170076612A1
• Time in Patent Office: 1,042 Days
• Field of Search: 701 2, 701 3
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64D 47/08 Arrangements of cameras
• CPC Class Codes: B64U 10/14 with four distinct rotor axes, e.g. quadcopters
• CPC Class Codes: B64U 20/87 Mounting of imaging devices, e.g. mounting of gimbals
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 30/20 Rotors; Rotor supports
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G08G 5/0013 with a ground station
• CPC Class Codes: G08G 5/0034 Assembly of a flight plan
• CPC Class Codes: G08G 5/0069 specially adapted for an unmanned aircraft
• CPC Class Codes: G08G 5/0086 for monitoring terrain radar or analogous systems specially adapted for terrain avoidance G01S13/935
• CPC Class Codes: H04B 7/185 Space-based or airborne stations; Stations for satellite systemsH04B7/204 takes precedence

Abstract

[Object] To provide an information processing device for enabling a user to easily carry out effective photography depending on a subject or location.

[Solution] Provided is an information processing device including: a flight route generation unit that presents a template of flight route information showing a flight route of a flying object, and generates flight route information of the flying object, associating the flight route information of the selected template with a flight range of the flying object, on the basis of an operation performed by a user.

Claims

1. An information processing device comprising:

processing circuitry configured to

control presentation of flight route template information showing different options resulting in different flight routes of a flying object,

receive a selection of an option corresponding to the flight route template information,

generate flight route information for the flying object based on the selected option, and

provide instructions for flight to the flying object based on the generated flight route information,

wherein the flight route template information includes three dimensional position information of the flying object or movement path data represented as a vector component.

2. The information processing device according to claim 1, wherein the different options include different scenes for flying the flying object.

3. The information processing device according to claim 1, wherein the flight route template information includes a photographing setting corresponding to a photographing mode of a camera provided in the flying object.

4. The information processing device according to claim 3, wherein the photographing setting includes at least one of photography start, photography end camera angle, framing, frame rate, and zoom setting.

5. The information processing device according to claim 1, wherein the flight route information further includes photographing setting information of a camera provided in the flying object.

6. The information processing device according to claim 1, wherein the processing circuitry is further configured to

control display of a flight route object corresponding to a flight route of the fling object for the selected option on a map,

move the flight route object on the map based on an operation performed by the user thereby setting the flight route object, and

generate the flight route information for the flying object based on the setting of the flight route object by the operation of the user.

7. The information processing device according to claim 6, wherein processing circuitry is further configured to generate the flight route information of the flying object by associating a position where the flight route object is arranged on the map with position information in a real world corresponding to the position on the map.

8. The information processing device according to claim 6, wherein the processing circuitry is further configured to control display of a preview of a captured image acquired by a camera provided in the flying object at an arbitrary position on the flight route object.

9. The information processing device according to claim 6, wherein one or a plurality of adjusting points are provided on a displayed flight route, and

the processing circuitry is configured to change the flight route information based on an operation performed by the user to an adjusting point.

10. The information processing device according to claim 9, wherein the adjusting point is displayable with a camera angle indication corresponding to a camera angle of the camera provided in the flying object, changes the camera angle of the camera changes in accordance with a change in a direction of the camera angle indication by an operation performed by the user.

11. The information processing device according to claim 9, wherein the processing circuitry changes the flight route information for the flying object in accordance with a movement of the adjusting point by an operation performed by the user.

12. The information processing device according to claim 1, further comprising:

a transceiver that performs information communication with at least the flying object, wherein the processing circuitry sends the instructions for flight to the flying object via the transceiver.

13. The information processing device according to claim 12, wherein the processing circuitry is configured to associate photographic information, obtained during flying a flight route corresponding to the flight route information with a camera provided in the flying object, with the flight route.

14. The information processing device according to claim 1, wherein the processing circuitry is further configured to communicate with a server that holds the flight route template information and acquires the flight route template information from the server.

15. The information processing device according to claim 1, wherein the flight route template information includes information defining a type of flight from a group comprising:

circular flight, twist flight, rolling flight and rising flight.

16. The information processing device according to claim 15, wherein the processing circuitry is further configured to control presentation of the flight route template information by patterning the different flight routes based on the type of flight from the group comprising:

circular flight, twist flight, rolling flight and rising flight.

17. An information processing method comprising:

controlling presentation of flight route template information showing different options resulting in different flight routes of a flying object;

receiving a selection of an option corresponding to the flight route template information;

generating flight route information for the flying object based on the selected option; and

providing instructions for flight to the flying object based on the generated flight route information,

wherein the flight route template information includes three dimensional position information of the flying object or movement path data represented as a vector component.

18. The information processing method according to claim 17, wherein the different options include different scenes for flying the flying object.

19. The information processing method according to claim 17, wherein the flight route template information includes a photographing setting corresponding to a photographing mode of a camera provided in the flying object.

20. The information processing method according to claim 17, wherein the flight route information further includes photographing setting information of a camera provided in the flying object.

21. The information processing method according to claim 17, further comprising:

controlling display of a flight route object corresponding to a flight route of the flying object for the selected option on a map,

moving the flight route object on the map based on an operation performed by the user thereby setting the flight route object, and

generating the flight route information for the flying object based on the setting of the flight route object by the operation of the user.

22. The information processing method according to claim 21, further comprising:

generating flight route information of the flying object by associating a position where the flight route object is arranged on the map with position information in a real world corresponding to the position on the map.

23. The information processing method according to claim 21, further comprising:

controlling display of a preview of a captured image acquired by a camera provided in the flying object at an arbitrary position on the flight route object.

24. The information processing method according to claim 21, wherein one or a plurality of adjusting points are provided on a displayed flight route, and

wherein the method further comprises changing the flight route information based on an operation performed by the user to an adjusting point.

25. The information processing method according to claim 24, wherein the adjusting point is displayable with a camera angle indication corresponding to a camera angle of the camera provided in the flying object, changes the camera angle of the camera changes in accordance with a change in a direction of the camera angle indication by an operation performed by the user.

26. The information processing method according to claim 24, further comprising:

changing the flight route information for the flying object in accordance with a movement of the adjusting point by an operation performed by the user.

27. The information processing method according to claim 17, further comprising:

performing information communication, using a transceiver, with at least the flying object, the communication including sending the instructions for flight to the flying object via the transceiver.

28. The information processing method according to claim 27, further comprising:

associating photographic information, obtained during flying a flight route corresponding to the flight route information with a camera provided in the flying object, with the flight route.

29. The information processing method according to claim 17, further comprising communicating with a server that holds the flight route template information and acquires the flight route template information from the server.

30. The information processing method according to claim 17, wherein the flight route template information includes information defining a type of flight from a group comprising:

circular flight, twist flight, rolling flight and rising flight.

31. The information processing method according to claim 30, further comprising:

controlling presentation of the flight route template information by patterning the different flight routes based on the type of flight from the group comprising;

circular flight, twist flight, rolling flight and rising flight.

32. A non-transitory computer readable medium storing thereon a program that when executed by a computer causes the computer to execute processing comprising:

controlling presentation of flight route template information showing different options resulting in different flight routes of a flying object;

receiving a selection of an option corresponding to the flight route template information;

generating flight route information for the flying object based on the selected option; and

providing instructions for flight to the flying object based on the generated flight route information,

wherein the flight route template information includes three dimensional position information of the flying object or movement path data represented as a vector component.

33. An imaging system comprising:

a flying object; and

an information processing terminal including

processing circuitry configured to

control presentation of flight route template information showing different options resulting in different flight routes of a flying object,

receive a selection of an option corresponding to the flight route template information,

generate flight route information for the flying object based on the selected option, and

provide instructions for flight to the flying object based on the generated flight route information,

wherein the flight route template information includes three dimensional position information of the flying object or movement path data represented as a vector component.