Virtual-scene control device

• US 10,142,561 B2
• Filed: 03/20/2017
• Issued: 11/27/2018
• Est. Priority Date: 07/19/2010
• Status: Active Grant

• Current Assignee: Lucasfilm Entertainment Co Ltd (The Walt Disney Company)
• Original Assignee: Lucasfilm Entertainment Co Ltd (The Walt Disney Company)
• Inventors: Reynolds, Spencer, Sanders, Michael, Wooley, Kevin, Sullivan, Steve, Schnitzer, Adam
• Primary Examiner(s): Zheng, Xuemei
• Application Number:
  US15/463,908
• Publication Number:
  US 20170195527A1
• Time in Patent Office: 617 Days
• CPC Class Codes: G06F 3/0202 Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0362 with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G11B 27/00 Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 5/2224 related to virtual studio applications
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A handheld device includes: an input control configured to control and modify a virtual scene including a virtual camera; and a display that shows a representation of the controlled and modified virtual scene generated by the virtual camera. A system includes: a computer system configured to execute program instructions for generating a virtual scene including a virtual camera; and handheld device configured to communicate with the computer system for controlling and modifying the virtual scene, the handheld device comprising: an input control configured to control and modify the virtual scene; and a display that shows a representation of the controlled and modified virtual scene generated by the virtual camera.

Claims

1. A handheld device that allows a user to control a virtual scene generated by a computer system, the virtual scene including one or more characters, a plurality of non-character assets and at least one virtual camera, the plurality of assets including one or more immoveable objects, moveable objects or self-propelled objects, the handheld device comprising:

a body;

an I/O channel configured to enable the handheld device to communicate with the computer system that generates the virtual scene;

a display mounted on the body and configured to show a representation of the virtual scene as generated by the at least one virtual camera; and

one or more input controls operable to enable;

(a) a first user-selected mode for recording images with a virtual camera of the at least one virtual camera in the virtual scene using the input controls, and (b) a second user-selected mode for selecting individual ones of the plurality of assets and moving the selected assets within the virtual scene and for selecting between different virtual lenses for the virtual camera.

2. The handheld device set forth in claim 1 wherein the one or more input controls comprises at least one scroll wheel that, when an asset is not selected, allows the user to alternate between available virtual lenses by scrolling the wheel and then select a lens by clicking on the wheel.

3. The handheld device set forth in claim 2 wherein the one or more input controls further comprises a first button that allows the user to select individual ones of the plurality of assets.

4. The handheld device set forth in claim 3 wherein the one or more input controls further comprises a second button that allows the user to move a selected asset to the user'"'"'s current location.

5. The handheld device set forth in claim 4 wherein the one or more input controls further comprises a third button that allows the user to set a selected object to a location in the virtual scene that can be set by the user by placing a reticule at the location.

6. The handheld device set forth in claim 1 wherein the one or more input controls comprises at least one scroll wheel that, when an asset is selected, moves the asset to a depth closer to or further from the at least one virtual camera.

7. The handheld device set forth in claim 6 wherein a direction of movement of the selected asset in dimensions other than the depth from the at least one virtual camera can be regulated by movement of the handheld device.

8. The handheld device of claim 1 wherein the one or more input controls are further operable to, after the asset has been selected, enable a user to move the asset closer to and further from the virtual camera as well as left and right and up and down within the virtual scene.

9. The handheld device of claim 1 wherein the one or more input controls are further operable to place the handheld device into a third mode in which the input controls enable a user to attach a virtual camera to an object in the virtual scene such that the camera moves to the object and a temporary association is created so that the virtual camera undergoes the same or similar movement as the object.

10. A handheld device that allows a user to control a virtual scene generated by a computer system, the virtual scene including one or more characters, a plurality of non-character assets and at least one virtual camera, the plurality of assets including one or more immoveable objects, moveable objects or self-propelled objects, the handheld device comprising:

a body having a camera form factor including a lens-like portion and a rotatable lens ring coupled to the lens-like portion;

an I/O channel configured to enable the handheld device to communicate with the computer system that generates the virtual scene;

input controls positioned on the body;

a display mounted on the body and configured to show a representation of the virtual scene as generated by the at least one virtual camera; and

a mode selection input control operable to place the handheld device into a first mode in which the handheld device is configured to enable the user to record images with a virtual camera of the at least one virtual camera in the virtual scene using the input controls, and a second mode in which the handheld device is configured to enable the user to use the input controls to select individual ones of the plurality of assets and move the selected assets within the virtual scene and to select between different virtual lenses for the virtual camera.

11. The handheld device of claim 10 wherein the rotatable lens ring enables control of focus length of the virtual camera.

12. The handheld device of claim 10 wherein the input controls further include motion sensors that enable a selected asset to be moved left/right and up/down within the virtual scene.

13. The handheld device of claim 10 wherein the input controls are further configured to allow a user to place an aiming reticle at a chosen location in the virtual scene, and include a control that can be selected to place the selected asset at a location identified by the aiming reticle.

14. The handheld device of claim 10 wherein the mode selection input control is further operable to place the handheld device into a third mode in which the input controls enable a user to attach a virtual camera to an object in the virtual scene such that the camera moves to the object and a temporary association is created so that the virtual camera undergoes the same or similar movement as the object.

15. A handheld device that allows a user to control a virtual scene generated by a computer system, the virtual scene including a plurality of virtual assets and at least one virtual camera, the handheld device comprising:

a body;

an I/O channel configured to enable the handheld device to communicate with the computer system that generates the virtual scene;

a display mounted on the body and configured to show a representation of the virtual scene as generated by the at least one virtual camera; and

an input control operable to enable (a) a first user selected mode for recording images with a virtual camera of the at least one virtual camera in the virtual scene, and (b) a second user selected mode for selecting between different virtual lenses for the virtual camera;

wherein the input control comprises a scroll wheel that, when a virtual asset is not selected, allows the user to alternate between available virtual lenses by scrolling the wheel and then select a virtual lens by clicking on the wheel.

16. The handheld device set forth in claim 15 wherein the input control comprises a first button that allows the user to select individual ones of the plurality of virtual assets.

17. The handheld device set forth in claim 16 wherein a direction of movement of a selected asset in different dimensions from the at least one virtual camera can be regulated by movement of the handheld device.

18. The handheld device of claim 15 further comprising at least one virtual button configured to be presented on the display, the virtual button configured to control an aspect on an application program that generates the virtual scene including the plurality of virtual assets and the virtual camera.

19. The handheld device of claim 15 wherein the display comprises a touchscreen that enables a user to control or modify the plurality of virtual assets or the virtual camera included in the virtual scene.