Controlling Robotic Motion of Camera

• US 20100149337A1
• Filed: 12/11/2008
• Published: 06/17/2010
• Est. Priority Date: 12/11/2008
• Status: Active Grant

• Current Assignee: Lucasfilm Entertainment Co Ltd (The Walt Disney Company)
• Original Assignee: Lucasfilm Entertainment Co Ltd (The Walt Disney Company)
• Inventors: Porcino, Domenico
• Granted Patent: US 8,698,898 B2
• Time in Patent Office: Days
• US Class Current: 348/159
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2228 Video assist systems used in motion picture production, e.g. video cameras connected to viewfinders of motion picture cameras or related video signal processing

Abstract

Among other disclosed subject matter, a system includes a first camera generating a live image of a scene, the first camera configured for being placed in a plurality of locations by robotic motion. The system includes a handheld device that includes a display device for continuously presenting the live image, wherein movement of the handheld device causes the handheld device to generate an output that controls the robotic motion.

Claims

1. A system comprising:

a first camera generating a live image of a scene, the first camera configured for being placed in a plurality of locations by robotic motion; and

a handheld device that includes a display device for continuously presenting the live image, wherein movement of the handheld device causes the handheld device to generate an output that controls the robotic motion.

2. The system of claim 1, wherein the handheld device includes a tablet device having a generally flat configuration with the display device located on a main face of the tablet device.

3. The system of claim 1, wherein the handheld device includes an inertia sensor and wherein the output controlling the robotic motion of the first camera is generated using the inertia sensor.

4. The system of claim 1, wherein the handheld device includes an optical sensor and wherein the output controlling the robotic motion of the first camera is generated using the optical sensor.

5. The system of claim 1, wherein the handheld device includes a magnetic sensor and wherein the output controlling the robotic motion of the first camera is generated using the magnetic sensor.

6. The system of claim 1, further comprising:

a plurality of second cameras mounted in a fixed arrangement around an area where the handheld device is to be used, the second cameras registering the movement of the handheld device, wherein the output controlling the robotic motion of the first camera is generated using the second cameras.

7. The system of claim 1, further comprising:

an automated crane on which the first camera is mounted, the automated crane configured for receiving the output and placing the first camera in any of the plurality of locations by the robotic motion.

8. The system of claim 1, wherein the first camera is associated with a first set where the scene takes place and wherein the first camera generates the live image from the first set, the system further comprising:

a second camera associated with a second set, the second camera configured to generate another live image from the second set;

wherein the output that controls the robotic motion of the first camera also controls the second camera.

9. The system of claim 8, wherein the second set is a virtual set generated by a computer and the second camera is a virtual camera generated by the computer.

10. A computer-implemented method for controlling a camera, the method comprising:

receiving location information regarding a handheld device carried by an operator, the handheld device including a display device for continuously presenting a live image from a first camera configured for being placed in a plurality of locations by robotic motion;

calculating a new location for the first camera using the location information; and

placing the first camera in the new location by the robotic motion while presenting the live image on the display device.

11. The computer-implemented method of claim 10, further comprising:

identifying an initial location of the first camera; and

calculating a path for the first camera from the initial location to the new location, the first camera to traverse the path by the robotic motion.

12. The computer-implemented method of claim 11, further comprising:

identifying at least one obstruction between the initial location and the new location; and

taking the obstruction into account in calculating the path so that the obstruction does not interfere with the first camera.

13. The computer-implemented method of claim 12, wherein the first camera is associated with a first set and the obstruction is identified using a model of the first set.

14. The computer-implemented method of claim 11, wherein calculating the path comprises:

determining a movement of the handheld device based on the location information;

scaling the movement into a scaled movement according to at least one predefined parameter; and

determining the path so that the first camera undergoes the scaled movement.

15. The computer-implemented method of claim 10, further comprising:

causing the first camera to undergo a predefined movement specified based on path information;

identifying an aspect of the predefined movement to be modified using the handheld device;

modifying a parameter using the location information, the parameter corresponding to the aspect of the predefined movement; and

recording the modified parameter in association with the path information such that the modified parameter is taken into account in a subsequent use of the path information.

16. The computer-implemented method of claim 15, further comprising:

registering an output from the handheld device generated by the operator moving the handheld device before the first camera undergoes the predefined movement, the operator moving the handheld device to specify the predefined movement; and

recording the path information based on the registered output before the first camera undergoes the predefined movement.

17. The computer-implemented method of claim 15, further comprising:

receiving the path information before the first camera undergoes the predefined movement, the path information received from an application program configured for specifying robotic camera control.

18. The computer-implemented method of claim 10, wherein the first camera is associated with a first set and generates the live image from the first set, the method further comprising:

associating a second camera with a second set, the second camera configured to generate another live image from the second set;

placing the second camera in another location based on the location information, while presenting at least portions of the live image and the other live image on the display device.

19. The computer-implemented method of claim 18, wherein the second set is a virtual set generated by a computer and the second camera is a virtual camera generated by the computer.

20. A system comprising:

a camera generating a live image of a scene;

an automated crane on which the camera is mounted, the camera configured for being placed in a plurality of locations by robotic motion using the automated crane;

a handheld device that includes a display device for continuously presenting the live image; and

a position detector generating an output that controls the robotic motion based on movement of the handheld device, wherein the robotic motion causes the camera to emulate the movement of the handheld device while the live image is presented on the display device.