REMOTE CONTROL METHOD AND TERMINAL

• US 20150268666A1
• Filed: 03/26/2015
• Published: 09/24/2015
• Est. Priority Date: 07/31/2013
• Status: Active Grant

• Current Assignee: SZ DJI Technology Co., Ltd. (d/b/a DJI) (iFlight Technology Company Limited)
• Original Assignee: SZ DJI Technology Co., Ltd. (d/b/a DJI) (iFlight Technology Company Limited)
• Inventors: Wang, Tao, Wang, Mingyu
• Granted Patent: US 10,747,225 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present application discloses a remote control method and apparatus for controlling the state of a movable object and/or a load carried thereon. The remote control method comprising: receiving, via an apparatus, a state signal that corresponds to a user'"'"'s position; remote-controlling the state of the a load being carried on a movable object based on the state signal; wherein the state of the load is the result of combining the movement of the load relative to the movable object and the movement of the object relative to its environment. For example, the control of the state can be achieved through the state of the apparatus itself, a user'"'"'s state captured by an apparatus, a graphical interface on a screen of an apparatus, or a voice command.

Claims

1. A method of controlling a state of a payload supported by a carrier on a vehicle, said method comprising:

receiving, at a receiver positioned on the vehicle, the carrier or the payload, from a touchscreen terminal that is remote relative to the vehicle, the carrier and the payload, a signal indicative of a gesture by a user on the touchscreen terminal; and

adjusting the state of the payload in response to the signal.

2. The method of claim 1, wherein the vehicle is an unmanned aerial vehicle.

3. The method of claim 1, wherein adjusting the state of the payload comprises adjusting an orientation or position of the vehicle while the vehicle is in flight.

4. The method of claim 1, wherein adjusting the state of the payload comprises adjusting the state of the payload relative to the vehicle.

5. The method of claim 1, wherein adjusting the state of the payload comprises adjusting a state of the vehicle, thereby adjusting the state of the payload.

6. The method of claim 1, wherein the state of the payload is an attitude of the payload.

7. The method of claim 1, wherein the gesture comprises pinching, spreading, swiping, sliding, circling, or paddling one or more fingers on the touchscreen terminal.

8. The method of claim 7, wherein sliding a finger across the touchscreen causes the payload to turn.

9. The method of claim 8, wherein sliding the finger up or down on the screen controls a pitch of the vehicle or the carrier.

10. The method of claim 8, wherein sliding the finger left or right on the screen control a left/right orientation of the vehicle or the carrier.

11. The method of claim 8, wherein sliding the finger in a clockwise or counterclockwise circle on the screen controls a left and right tilt of the vehicle or the carrier.

12. The method of claim 8, wherein sliding the finger across the touchscreen causes the carrier to actuate one or more frame component of the carrier, thereby causing the payload to turn relative to the vehicle.

13. The method of claim 7, wherein the gesture simulates a movement of the carrier and/or payload.

14. The method of claim 1, wherein the payload is an imaging device.

15. The method of claim 14, wherein the touchscreen terminal displays an image captured or being captured by the imaging device.

16. The method of claim 15, wherein the gesture comprises sliding a finger across the image to adjust the field of view shown in the image.

17. The method of claim 14, wherein the gesture controls a focal length of the imaging device.

18. The method of claim 17, wherein two finger pinching and un-pinching controls the camera'"'"'s focal length.

19. The method of claim 1, wherein the carrier comprises (1) one or more frame components configured to support the payload and (2) one or more actuators configured to respond to a command signal to actuate the one or more frame components.

20. The method of claim 19, wherein the one or more frame components are connected to one another to form a gimbal having at least three axes.

21. The method of claim 19, wherein the state of the payload is adjusted via actuation of the one or more frame components about one or more orthogonal axes of rotation.

22. A remote terminal configured to control a state of a payload supported by a carrier on a vehicle, said terminal comprising:

a touchscreen user interface;

one or more processors that, individually or collectively, generate a signal indicative of a gesture by a user on the touchscreen user interface; and

a communication unit that transmits the signal to the vehicle, the carrier or the payload to adjust the state of the payload.

23. The remote terminal of claim 22, further comprising an extension configured to secure the remote terminal to a portion of the user'"'"'s body.

24. The remote terminal of claim 22, wherein the remote terminal is a smartphone, tablet, computer, or video-enabled remote control.

25. The remote terminal of claim 22, wherein the communication unit also transmits a signal indicative of an attitude of the remote terminal to the vehicle, the carrier or the payload to adjust the state of the payload.

26. The remote terminal of claim 25, wherein the state of the payload is the attitude of the payload.

27. The remote terminal of claim 26 wherein the attitude of the remote terminal and the attitude of the payload have one or more of the following relationships:

angle-to-angle, angle-to-speed, or angle-to-acceleration.

28. The remote terminal of claim 22, wherein the communication unit also transmits a signal indicative of lateral motion of the remote terminal to the vehicle, the carrier or the payload to adjust the state of the payload.

29. The remote terminal of claim 28, wherein the state of the payload is the lateral motion of the payload.

30. The remote terminal of claim 22, wherein operation of the vehicle or the carrier is achieved via virtual joystick shown on the touchscreen user interface.

31. A non-transitory computer-readable medium comprising program instructions for controlling a state of a payload supported by a carrier on a vehicle, said non-transitory computer readable medium comprising:

program instructions for generating a signal indicative of a gesture by a user on a touchscreen user interface;

program instructions to effect transmission of the signal to the vehicle, the carrier or the payload to adjust the state of the payload.

32. The non-transitory computer readable medium of claim 31, wherein adjustment of the state of the payload comprises adjusting the state of the payload relative to the vehicle.

33. The non-transitory computer readable medium of claim 32, wherein the state of the payload is an attitude of the payload.

34. The non-transitory computer readable medium of claim 31, wherein the gesture comprises pinching, spreading, swiping, sliding, circling, or paddling one or more fingers on the touchscreen terminal.

35. The non-transitory computer readable medium of claim 34, wherein sliding a finger across the touchscreen causes the payload to turn.

36. The non-transitory computer readable medium of claim 31, further comprising program instructions for generating a signal to display a virtual joystick on the touchscreen user interface.