METHOD FOR CONTROLLING MOTIONS AND ACTIONS OF AN APPARATUS INCLUDING AN IMAGE CAPTURE DEVICE HAVING A MOVING DEVICE CONNECTED THERETO USING A CONTROLLING DEVICE

• US 20170214856A1
• Filed: 12/30/2016
• Published: 07/27/2017
• Est. Priority Date: 01/22/2016
• Status: Abandoned Application

• Current Assignee: MediaTek, Inc.
• Original Assignee: MediaTek, Inc.
• Inventors: LIAO, Cheng-Yu, CHAN, Cheng-Che, CHEN, Cheng-Che
• Application Number:
  US15/395,407
• Publication Number:
  US 20170214856A1
• Time in Patent Office: Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

Method for controlling motions and actions of an apparatus including an image capture device having a moving device connected thereto using a controlling device is provided, wherein the moving device is capable of moving the image capture device. The method includes: displaying preview image provided by the image capture device on a display device of the controlling device; detecting inputs to alter the preview image from an input device of the controlling device; obtaining a first image to be captured based on the detected inputs; generating one or more first control commands according to the first image; and transmitting the one or more first control commands to the apparatus via a communication link to control motions and actions of the image capture device and the moving device to capture a second image to be returned, which is the same as the first image, to the controlling device.

Claims

1. A method for controlling motions and actions of an apparatus including an image capture device having a moving device connected thereto using a controlling device, wherein the moving device is capable of moving the image capture device, the method comprising:

displaying a preview image provided by the image capture device on a display device of the controlling device;

detecting inputs to alter the preview image from an input device of the controlling device on a user interface;

obtaining a first image to be captured based on the detected inputs, wherein the first image is associated with the altered preview image;

generating one or more first control commands according to the first image; and

transmitting the one or more first control commands to the apparatus via a communication link to control motions and actions of the image capture device and the moving device to capture a second image to be returned to the controlling device;

wherein the second image returned is the same as the first image.

2. The method of claim 1, further comprising:

displaying the second image as the preview image on the display device when receiving the second image;

detecting inputs to alter the second image from the input device;

obtaining a third image to be captured based on the detected inputs, wherein the third image is associated with the altered second image;

generating one or more second control commands according to the third image; and

transmitting the one or more second control commands to the apparatus via the communication link to control the movements and actions of the image capture device and the moving device to capture a fourth image to be returned to the controlling device;

wherein the fourth image returned is the same as the third image.

3. The method of claim 1, wherein the communication link comprises wired and wireless communication links.

4. The method of claim 1, wherein the controlling of the motions and actions of the image capture device and the moving device comprises at least one of controlling the moving device to change a position of the image capture device, rotating the image capture device and enabling zoom-in and zoom-out operation on the image capture device.

5. The method of claim 1, further comprising:

displaying a first cropped region of the second image as the preview image on the display device when receiving the second image; and

when detecting inputs from the input device, determining a second cropped region of the second image based on the detected inputs and displaying the second cropped region of the second image as the preview image.

6. The method of claim 1, wherein during returning the second image captured by the image capture device of the apparatus, the method further comprises:

transmitting a low resolution version of the second image from the apparatus to the controlling device;

displaying the low resolution version of the second image as the preview image on the display device;

transmitting a full resolution version of the second image from the apparatus to the controlling device of the controlling device; and

displaying the full resolution version of the second image as the preview image on the display device of the controlling device.

7. The method of claim 1, wherein generating the one or more first control commands according to the first image further comprising:

obtaining a first moving distance on the display device according to the detected inputs;

determining a second moving distance to move the image capture device based on the obtained first moving distance; and

generating the one or more first control commands to move the image capture device according to the second moving distance;

,

wherein the length of the first moving distance is a plurality of times of the length of the second moving distance.

8. The method of claim 1, further comprising:

prior to receiving the second image from the apparatus, generating an indicator on the preview image displayed on the display device according to the detected inputs.

9. The method of claim 1, further comprising:

determining a target position for the image capture device based on the first image; and

using the first control commands to control the moving device to move the image capture device to the target position;

wherein when the moving of the moving device is stopped and the image capture device is not moved to the target position, the image capture device further performs an optical zooming operation to move to the target position and performs a digital zooming operation to move to the target position when the image capture device is still not moved to the target position after the optical zooming operation has been performed.

10. The method of claim 1, when the apparatus is equipped with a display device, and the method further comprises:

displaying instruction information which instructs how to manually move the image capture device to obtain the second image on the display device of the apparatus.

11. The method of claim 1, wherein the controlling device is a mobile device and the apparatus is a drone.

12. The method of claim 1, wherein the controlling device is a mobile device, the image capture device is a camera of the mobile device and the moving device is an optical lens module of the camera of the mobile device.

17. The controlling system of claim 1, wherein during returning the second image captured by the image capture device of the apparatus, the apparatus is further configured to transmit a low resolution version of the second image to the controlling device and the controlling device is further configured to display the low resolution version of the second image as the preview image on the display device upon receiving the low resolution version of the second image;

and the apparatus is further configured to transmit a full resolution version of the second image to the controlling device and the controlling device is further configured to display the full resolution version of the second image as the preview image on the display device of the controlling device.

13. A controlling system, comprising:

an apparatus including an image capture device having a moving device connected thereto, wherein the moving device is capable of moving the image capture device that captures images;

a controlling device coupled to the apparatus via a communication link for controlling motions and actions of the image capture device and the moving device in the apparatus,

wherein the controlling device is configured to display a preview image provided by the image capture device on a display device of the controlling device, detect inputs to alter the preview image from an input device, obtain a first image to be captured based on the detected inputs, generate one or more first control commands according to the first image, and transmit the one or more first control commands to the apparatus via the communication link to control the image capture device and the moving device to capture a second image to be returned to the controlling device;

wherein the first image is associated with the altered first image and the second image returned is the same as same as the first image.

14. The controlling system of claim 13, wherein the controlling device is further configured to display the second image as the preview image on the display device when receiving the second image, detect inputs to alter the second image from the input device, obtain a third image to be captured based on the detected inputs, wherein the third image is associated with the altered second image, generate one or more second control commands according to the third image, and transmit the one or more second control commands to the apparatus via the communication link to control the motions and actions of the image capture device and the moving device to capture a fourth image to be returned to the controlling device;

wherein the fourth image returned is the same as the third image.

15. The controlling system of claim 13, wherein the controlling of the motions and actions of the image capture device and the moving device comprises at least one of controlling the moving device to change a position of the image capture device, rotating the image capture device and enabling zoom-in and zoom-out operation on the image capture device.

16. The controlling system of claim 13, wherein the controlling device is further configured to display a first cropped region of the second image as the preview image on the display device when receiving the second image and when detecting inputs from the input device, determine a second cropped region of the second image based on the detected inputs and displaying the second cropped region of the second image as the preview image.

18. The controlling system of claim 13, wherein the controlling device is further configured to generate the one or more first control commands according to the first image by obtaining a first moving distance on the display device according to the detected inputs;

determining a second moving distance to move the image capture device based on the obtained first moving distance; and

generating the one or more first control commands to move the image capture device according to the second moving distance;

wherein the length of the first moving distance is a plurality of times of the length of the second moving distance.

19. The controlling system of claim 13, wherein prior to receiving the second image from the apparatus, the controlling device is further configured to generate an indicator on the preview image displayed on the display device according to the detected inputs.

20. The controlling system of claim 13, wherein the controlling device is further configured to use the first control commands to control the moving device to move the image capture device to the target position, wherein when the moving of the moving device is stopped and the image capture device is not moved to the target position, the image capture device further performs an optical zooming operation to move to the target position and performs a digital zooming operation to move to the target position when the image capture device is still not moved to the target position after the optical zooming operation has been performed.