Camera and animation controller, systems and methods

• US 7,433,760 B2
• Filed: 10/28/2005
• Issued: 10/07/2008
• Est. Priority Date: 10/28/2004
• Status: Expired due to Fees

• Current Assignee: Accelerated Pictures, Inc.
• Original Assignee: Accelerated Pictures, Inc.
• Inventors: Parry, Mark, Alvarez, Donald
• Primary Examiner(s): BARNES-BULLOCK, CRYSTAL JOY
• Application Number:
  US11/261,441
• Publication Number:
  US 20060106494A1
• Time in Patent Office: 1,075 Days
• Field of Search: 700/56, 700/57, 700/59, 700/61, 700/62, 700/64, 700/65, 700/251, 700/259, 348/207.99, 348/207.1, 348/207.11, 348/208.99, 3482081-2087, 348/211.8, 348/211.13, 348/135, 352/53, 362/233, 382/103
• US Class Current: 700/251
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 2219/35438 Joystick
• CPC Class Codes: G05B 2219/35448 Datasuit, arm sleeve, actor, operator wears datasuit and generates motion
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: G06T 2213/08 Animation software package
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

Embodiments of the invention provide novel controllers for filmmaking and/or animation, as well as systems and methods for their use. In a set of embodiments, a controller has an actuator (e.g., a joystick, etc.) that receives input from a user for controlling an object, such as a camera, a light, an animated character, etc. The input is provided as instructions, which are described according to a reference coordinate system, to a movement system for moving the object within a scene (i.e., relative to other objects within the scene). The controller may include an additional control allowing the user to define an auxiliary coordinate system, such that the input from the user is described according to the auxiliary coordinate system. Alternatively and/or additionally, the controller includes a control for allowing the user to select whether input should be described according to the auxiliary coordinate system or the reference coordinate system.

Claims

1. A control system for a mechanical, electronic or virtual digital system, wherein the control system controls at least a location of an object in a two-dimensional surface or three-dimensional space based on human user input specifying movement according to a coordinate system, the control system comprising:

user inputs for receiving location changes specified according to a first coordinate system;

a movement system configured to move the object according to the location changes specified in the first coordinate system;

user inputs for changing from the first coordinate system to a second coordinate system;

logic for operating the movement system in the second coordinate system when the user inputs specify a change in coordinate systems; and

user inputs for specifying one or more conversions between the first and second coordinate systems;

wherein the object is selected from the group consisting of a camera, a light, a character, a prop, a manned vehicle, an unmanned vehicle and a flying camera platform.

2. A control system as recited by claim 1, wherein the user inputs specify location changes in a current coordinate system, selected among the first and second coordinate systems, according to a coordinate system input, and wherein the user inputs include dimensional subcomponents such that each subcomponent allows a user to independently specify movement along an independent axis of the current coordinate system.

25. A control system as recited by claim 1, wherein the object is virtual, such that the movement of the object within the scene is also virtual.

3. A system for moving an object, the system comprising:

a controller configured to receive input from a user and, based on the received input, provide instructions to a movement system for moving a first object relative to at least one other object within a scene, wherein the input is described according to an auxiliary coordinate system;

a movement system configured to move the first object according to the instructions; and

logic to allow the user of the controller to define a set of controller axes defining the auxiliary coordinate system, and to translate the input from the auxiliary coordinate system to the reference coordinate system before providing the input as instructions to the movement system according to a reference coordinate system;

wherein the first object is selected from the group consisting of a camera, a light, a character, a prop, a manned vehicle, an unmanned vehicle and a flying camera platform.

4. A system as recited by claim 3, wherein moving the first object relative to at least one other object within a scene comprises changing an orientation of the object.

5. A system as recited by claim 3, wherein the logic further allows the user of the controller to define a second set of controller axes defining a second auxiliary coordinate system.

6. A system as recited by claim 3, wherein the logic further allows the user of the controller to toggle between the reference coordinate system and the auxiliary coordinate system.

7. A system as recited by claim 6, wherein the controller comprises a control to enable the user to define the set of controller axes.

8. A system as recited by claim 3, wherein the set of controller axes are defined by a current orientation of the object.

9. A system as recited by claim 3, wherein the logic allows the user of the controller to define the set of axes while the first object is moving.

10. A system as recited by claim 3, wherein the auxiliary coordinate system is selected from the group consisting of world relative coordinates, object relative coordinates, crane axes relative coordinates, motorized track relative coordinates, and rotation system coordinates.

11. A system as recited by claim 3, wherein the reference coordinate system is selected from the group consisting of world relative coordinates, object relative coordinates, crane axes relative coordinates, motorized track relative coordinates, and rotation system coordinates.

12. A system as recited by claim 3, wherein the first object is real.

13. A system as recited by claim 3, wherein the first object is virtual, such that the movement of the first object within the scene is also virtual.

14. A system as recited by claim 3, wherein the first object is an optical transceiver.

15. A system as recited by claim 3, wherein:

the set of controller axes is a first set of controller axes defining the auxiliary coordinate system; and

the reference coordinate system comprises a second set of controller axes defining the reference coordinate system.

16. A system as recited by claim 15, wherein at least one controller axis describes an arbitrary mathematical functions of space and/or space and time.

17. A system as recited by claim 15, wherein at least one controller axis is a rotational axis.

18. A system as recited by claim 15, wherein at least one axis in the first set of controller axes and at least one axis in the second set of controller axes share a common arbitrary mathematical function of space and/or time.

19. A system as recited by claim 3, wherein the controller comprises at least one actuator.

20. A system as recited by claim 19, wherein the at least one actuator comprises a joystick.

21. A system as recited by claim 3, wherein the controller comprises at least one device selected from the group consisting of a game controller, a mouse, a keyboard, a steering wheel, an inertial control system, and an optical control system.

22. A system as recited by claim 3, further comprising:

a storage medium; and

logic for recording actuator movement to the storage medium for later playback.

23. A system as recited by claim 3, further comprising:

a storage medium; and

logic for recording object movement to the storage medium for later playback.

24. A system as recited by claim 3, further comprising:

a storage medium; and

logic for storing the auxiliary coordinate system to the storage medium.

26. A system for moving an object, the system comprising:

a controller configured to receive input from a user and, based on the received input, provide instructions to a movement system for moving an optical transceiver relative to at least one other object within a scene, the optical transceiver projecting and/or receiving light along an axis, wherein the input is described according to an auxiliary coordinate system;

a movement system configured to move the optical transceiver according to the instructions; and

logic to allow the user of the controller to define a set of controller axes defining the auxiliary coordinate system, and to translate the input from the auxiliary coordinate system to the reference coordinate system before providing the input as instructions to the movement system according to a reference coordinate system;

wherein the controller is further configured to receive second input from the user, and based on the received second input, provide instructions to a second movement system for orienting a view of the optical transceiver; and

the system further comprises a second movement system configured to orient a view of the optical transceiver, subject to the second set of instructions from the controller.

27. A system as recited by claim 26, wherein the optical transceiver is selected from the group consisting of a virtual optical transceiver, a light, a camera, and a light projecting a beam symmetrical about an axis chosen relative to the optical transceiver.

28. A system as recited by claim 26, wherein:

the controller comprises a plurality of actuators comprising a first actuator and a second actuator;

the first actuator receives input related to a movement of the optical transceiver; and

the second actuator receives input related to an orientation of the optical transceiver.

29. A system for moving an object, comprising:

a controller configured to receive input from a user and, based on the received input, provide instructions to a movement system for moving a first object relative to at least one other object within a scene;

a movement system configured to move the first object according to the instructions;

logic to allow the user of the controller to toggle between a reference coordinate system and an auxiliary coordinate system, such that the user input is described according to either the reference coordinate system or the auxiliary coordinate system; and

logic to translate the input from the user as necessary from the auxiliary coordinate system to the reference coordinate system, such that the instructions are provided to the movement system according to the reference coordinate system;

wherein the first object is selected from the group consisting of a camera, a light, a character, a prop, a manned vehicle, an unmanned vehicle and a flying camera platform.

30. A system as recited by claim 29, wherein the logic allows the user of the controller to toggle between the reference coordinate system and the auxiliary coordinate system while the object is moving.

31. A system as recited by claim 29, wherein the logic further allows the user of the controller to define a set of controller axes defining the auxiliary coordinate system.

32. A system as recited by claim 29, wherein the logic further allows the user of the controller to toggle between the reference coordinate system and one or more of a plurality of auxiliary coordinate systems.

33. A system as recited by claim 29, wherein the controller comprises a control to enable the user to toggle between the reference coordinate system and the auxiliary coordinate system.

34. A system as recited by claim 29, wherein the first object is virtual, such that the movement of the first object within the scene is also virtual.

35. A method of moving an object, the method comprising:

receiving at a controller input from a user for moving a first object relative to at least one other object within a scene, wherein the input is described according to an auxiliary coordinate system;

allowing the user of the controller to define a set of controller axes defining the auxiliary coordinate system;

translating the input from the auxiliary coordinate system to a reference coordinate system; and

providing instructions to a movement system for moving the first object, based on the translated input received from the user, wherein the instructions are described according to the reference coordinate system;

wherein the first object is selected from the group consisting of a camera, a light, a character, a prop, a manned vehicle, an unmanned vehicle and a flying camera platform.

36. A method as recited by claim 35, further comprising:

moving the first object based on the instructions.

37. A method as recited by claim 35, further comprising:

allowing the user to toggle between the reference coordinate system and the auxiliary coordinate system.

38. A method as recited by claim 35, wherein the first object is virtual, such that the movement of the first object within the scene is also virtual.

39. A method of moving an object, the method comprising:

receiving at a controller input from a user for moving a first object relative to at least one other object within a scene;

allowing the user of the controller to toggle between a reference coordinate system and an auxiliary coordinate system, such that when the user selects the reference coordinate system, the input is described according to the reference coordinate system, and when the user selects the auxiliary coordinate system, the input is described according to the auxiliary coordinate system;

if necessary, translating the input received from the user from the auxiliary coordinate system to the reference coordinate system; and

providing instructions to a movement system for moving the first object, based on the input received from the user, wherein the instructions are described according to the reference coordinate system;

wherein the first object is selected from the group consisting of a camera, a light, a character, a prop, a manned vehicle, an unmanned vehicle and a flying camera platform.

40. A method as recited by claim 39, wherein the first object is virtual, such that the movement of the first object within the scene is also virtual.

41. A system for moving an object, the system comprising:

a controller configured to receive input from a user to move a first object relative to at least one other object within a scene, wherein the input is described according to an auxiliary coordinate system, and wherein the first object is selected from the group consisting of a camera, a light, a character, a prop, a manned vehicle, an unmanned vehicle and a flying camera platform;

a movement system configured to move the first object according to movement instructions received from a computer; and

a computer in communication with the controller and the movement system, the computer comprising a processor and a set instructions, the set of instructions comprising;

a) instructions executable by the processor to receive the input from the controller;

b) instructions executable by the processor to allow the user to define a set of controller axes defining the auxiliary coordinate system;

c) instructions to translate the input from the auxiliary coordinate system to the reference coordinate system; and

d) instructions based on the received input, provide movement instructions to a movement system, wherein the movement instructions are described according to the reference coordinate system.

42. A system as recited by claim 41, wherein the first object is virtual, such that the movement of the first object within the scene is also virtual.

43. A method of moving an object, the method comprising:

receiving at a controller input from a user for moving an optical transceiver relative to at least one other object within a scene, the optical transceiver projecting and/or receiving light along an axis, wherein the input is described according to an auxiliary coordinate system;

allowing the user of the controller to define a set of controller axes defining the auxiliary coordinate system;

translating the input from the auxiliary coordinate system to a reference coordinate system; and

providing instructions to a movement system for moving the optical transceiver, based on the translated input received from the user, wherein the instructions are described according to the reference coordinate system;

receiving, at the controller, second input from the user; and

based on the second input, providing instructions to a second movement system for orienting a view of the optical transceiver.

44. A method as recited by claim 43, wherein the optical transceiver is selected from the group consisting of a virtual optical transceiver, a light, a camera, and a light projecting a beam symmetrical about an axis chosen relative to the optical transceiver.

45. A method of moving an object, the method comprising:

receiving at a controller input from a user for moving an optical transceiver relative to at least one other object within a scene, the optical transceiver projecting and/or receiving light along an axis;

allowing the user of the controller to toggle between a reference coordinate system and an auxiliary coordinate system, such that when the user selects the reference coordinate system, the input is described according to the reference coordinate system, and when the user selects the auxiliary coordinate system, the input is described according to the auxiliary coordinate system;

if necessary, translating the input received from the user from the auxiliary coordinate system to the reference coordinate system; and

providing instructions to a movement system for moving the optical transceiver, based on the input received from the user, wherein the instructions are described according to the reference coordinate system;

receiving, at the controller, second input from the user; and

based on the second input, providing instructions to a second movement system for orienting a view of the optical transceiver.

46. A method as recited by claim 45, wherein the optical transceiver is selected from the group consisting of a virtual optical transceiver, a light, a camera, and a light projecting a beam symmetrical about an axis chosen relative to the optical transceiver.