Controlling robotic motion of camera

• US 8,698,898 B2
• Filed: 12/11/2008
• Issued: 04/15/2014
• Est. Priority Date: 12/11/2008
• Status: Active Grant

• Current Assignee: Lucasfilm Limited (The Walt Disney Company)
• Original Assignee: Lucasfilm Limited (The Walt Disney Company)
• Inventors: Porcino, Domenico
• Primary Examiner(s): NANO, SARGON N
• Application Number:
  US12/333,169
• Publication Number:
  US 20100149337A1
• Time in Patent Office: 1,951 Days
• Field of Search: 348/14.03, 348/14.04, 348/116, 348/159, 348/169, 348/211.99
• US Class Current: 348/159
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2228 Video assist systems used in motion picture production, e.g. video cameras connected to viewfinders of motion picture cameras or related video signal processing

Abstract

Among other disclosed subject matter, a system includes a first camera generating a live image of a scene, the first camera configured for being placed in a plurality of locations by robotic motion. The system includes a handheld device that includes a display device for continuously presenting the live image, wherein movement of the handheld device causes the handheld device to generate an output that controls the robotic motion.

Claims

1. A system for recording a motion picture performance comprising:

a movie making set in which one or more performers act out a scene for a motion picture;

a camera generating a live image of at least one of the performers while the performers act out the scene, the camera including a robotic movement device configured to move the camera;

a tablet device that is held and moved within a capture area by a user while the performers act out the scene, the tablet device including a display device for continuously presenting the live image;

a sensor that generates tracking data that represents the movements of the tablet device within the capture area; and

a controller that is communicably coupled to the camera, the tablet device and the sensor, and that;

converts the tracking data to movement commands by increasing a scale of the movements of the tablet device;

applies the movement commands to a virtual camera in a virtual set such that the virtual camera moves within the virtual set in real time according to the movements of the tablet by the user; and

applies the movement commands to the robotic movement device such that the camera moves in real time according to the movements of the tablet by the user, wherein the tablet device provides the user a real time view of at least portions of live images from both the camera and virtual camera combined together.

2. The system of claim 1, wherein the tablet device has a generally flat configuration with the display device located on a main face of the tablet device.

3. The system of claim 1, wherein the sensor includes an inertia sensor included in the tablet device.

4. The system of claim 1, wherein the sensor includes an optical sensor included in the tablet device.

5. The system of claim 1, wherein the sensor includes a magnetic sensor included in the tablet device.

6. The system of claim 1, wherein the sensor includes a plurality of sensors mounted in a fixed arrangement around the capture area, the sensors generating the tracking data by registering the movement of the handheld device.

7. The system of claim 1, wherein the robotic movement device includes a crane.

8. The system of claim 1, further comprising:

another movie making set in which one or more other performers act out the scene for the motion picture; and

another camera generating another live image of at least one of the other performers while the other performers act out the scene, the other camera including another robotic movement device configured to move the other camera;

wherein the controller applies the movement commands also to the other camera such that the other camera moves in real time according to the movements of the tablet by the motion picture director, wherein the tablet device provides the motion picture director a real time view of what the scene looks like when captured by the camera and when captured by the other camera.

9. The system of claim 1, wherein the controller, before applying the movement commands to the robotic movement device:

identifies an obstruction that would interfere with the camera if the movement commands were applied to the robotic movement device;

takes the obstruction into account in converting the tracking data to the movement commands so that the obstruction does not interfere with the camera.

10. The system of claim 1, wherein the controller converts the tracking data to the movement data in part by scaling the tracking data by a predefined parameter.

11. The system of claim 1, wherein the camera generates a video recording of the live image.

12. A method of recording a video sequence comprising:

generating a live image of at least one or more performers acting out a scene on a set with a camera;

controlling the camera, with a controller that is communicably coupled to the camera, a tablet device and a sensor, while the performers act out the scene by;

receiving, from the sensor, tracking data that represents the movements of the tablet device held by a user and moveable within a capture area;

converting the tracking data to movement commands by increasing a scale of the movements of the tablet device;

applying the movement commands to a virtual camera in a virtual set such that the virtual camera moves within the virtual set in real time according to the movements of the tablet by the user; and

applying the movement commands to a robotic movement device that controls the camera such that the camera moves in real time according to the movements of the tablet by the user, wherein the tablet device provides the user a real time view of at least portions of live images from both the camera and virtual camera combined together on a display of the table device.

13. The method of claim 12 wherein the tablet device has a generally flat configuration with the display device located on a main face of the tablet device.

14. The method of claim 12 wherein the sensor includes an inertia sensor included in the tablet device.

15. The method of claim 12 wherein the sensor includes an optical sensor included in the tablet device.

16. The method of claim 12 wherein the sensor includes a plurality of sensors mounted in a fixed arrangement around the capture area, the sensors generating the tracking data by registering the movement of the handheld device.

17. The method of claim 12 wherein the controller converts the tracking data to the movement data in part by scaling the tracking data by a predefined parameter.

18. The method of claim 12 wherein the controller, before applying the movement commands to the robotic movement device identifies an obstruction that would interfere with the camera if the movement commands were applied to the robotic movement device, and takes the obstruction into account in converting the tracking data to the movement commands so that the obstruction does not interfere with the camera.

19. A non-transitory computer readable memory having a plurality of instructions stored thereon that, when executed by a processor, carry out a method of controlling a camera that generates a live image of at least one or more performers acting out a scene on a set with a tablet device held by a user and moveable within a capture area while the performers act out the scene, the method comprising:

receiving, from a sensor, tracking data that represents the movements of a tablet device held by a user and moveable within a capture area;

converting the tracking data to movement commands by increasing a scale of the movements of the tablet device;

applying the movement commands to a virtual camera in a virtual set such that the virtual camera moves within the virtual set in real time according to the movements of the tablet by the user; and

applying the movement commands to a robotic movement device that controls the camera such that the camera moves in real time according to the movements of the tablet by the user, wherein the tablet device provides the user a real time view of at least portions of live images from both the camera and virtual camera combined together on a display of the table device.

20. The non-transitory computer readable memory of claim 19 wherein the tablet device has a generally flat configuration with the display device located on a main face of the tablet device.

21. The non-transitory computer readable memory of claim 19 wherein the sensor includes an inertia sensor included in the tablet device.

22. The non-transitory computer readable memory of claim 19 wherein the sensor includes an optical sensor included in the tablet device.

23. The non-transitory computer readable memory of claim 19 wherein the sensor includes a plurality of sensors mounted in a fixed arrangement around the capture area, the sensors generating the tracking data by registering the movement of the handheld device.

24. The non-transitory computer readable memory of claim 19 wherein the controller converts the tracking data to the movement data in part by scaling the tracking data by a predefined parameter.

25. The non-transitory computer readable memory of claim 19 wherein the method includes, before applying the movement commands to the robotic movement device, identifying an obstruction that would interfere with the camera if the movement commands were applied to the robotic movement device, and taking the obstruction into account in converting the tracking data to the movement commands so that the obstruction does not interfere with the camera.