Method and apparatus for using a common pointing input to control 3D viewpoint and object targeting

• US 8,277,316 B2
• Filed: 09/14/2006
• Issued: 10/02/2012
• Est. Priority Date: 09/14/2006
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Haigh-Hutchinson, Mark
• Primary Examiner(s): Suhol, Dmitry
• Assistant Examiner(s): GRAY, BRANDON RAMON
• Application Number:
  US11/531,961
• Publication Number:
  US 20080070684A1
• Time in Patent Office: 2,210 Days
• Field of Search: 463/30, 463/31, 463/32, 463/33
• US Class Current: 463/31
• CPC Class Codes: A63F 13/20 Input arrangements for video game devices
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/5258 by dynamically adapting the position of the virtual camera to keep a game object or game character in its viewing frustum, e.g. for tracking a character or a ball
• CPC Class Codes: A63F 13/5375 for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/305 for providing a graphical or textual hint to the player
• CPC Class Codes: A63F 2300/6676 by dedicated player input
• CPC Class Codes: A63F 2300/6684 by dynamically adapting its position to keep a game object in its viewing frustrum, e.g. for tracking a character or a ball
• CPC Class Codes: A63F 2300/8076 Shooting

Abstract

A computer graphics display system such as a video game system provides virtual camera 3-D viewpoint panning control based on a pointer. When the pointer is displayed within a virtual camera panning control region, the system automatically pans the virtual camera toward the pointer. When the pointer is displayed within a different region, panning is deactivated and the user can freely move the cursor (e.g., to control the direction a weapon is pointed) without panning the virtual camera viewpoint. Flexible viewpoint control and other animated features are provided based on a pointing device such as a handheld video game optical pointing control. Useful applications include but are not limited to first person shooter type video games.

Claims

1. A method of allowing a video game user to use a weapon targeting marker to both (a) target a virtual weapon and (b) progressively pan in a desired direction a displayed 3-D viewpoint within a three-dimensional video game computer graphics display system to reveal additional portions of a 3D virtual world, the method comprising:

displaying, on a display in a display area, an image of a three-dimensional virtual world viewed from a viewpoint, the three-dimensional virtual world including at least one virtual object which the user can control a virtual weapon to aim at;

dividing said display area into at least an outer region and an inner region, the outer region surrounding the inner region;

displaying a weapon targeting marker on said display at a position that is at least in part responsive to a user input, said weapon targeting marker indicating a location within said three-dimensional virtual world at which said virtual weapon is aiming;

positioning the weapon targeting marker at a position that is responsive to user manipulation of an input device, thereby allowing the user to target the at least one displayed virtual object;

progressively panning the 3-D viewpoint to reveal additional portions of the 3D world for display while simultaneously changing the location of the weapon targeting marker within the three-dimensional virtual world when the user manipulates the input device to position the weapon targeting marker within the outer region; and

changing the location of the weapon targeting marker within the three-dimensional virtual world without changing the 3-D viewpoint when the user manipulates the input device to move the weapon targeting marker within the inner region.

2. The method of claim 1 further including controlling a rate of progressive panning at least in part in response to a distance between the position of the weapon targeting marker and a center point of the display.

3. The method of claim 1 further including controlling a rate of progressive panning based at least in part on how long the weapon targeting marker remains within the outer region.

4. The method of claim 1 further including subdividing said outer region into a plurality of control regions, and controlling a panning rate based at least in part on which of said plurality of control regions the weapon targeting marker is within.

5. The method of claim 1 further including displaying a weapon targeting reticle image, wherein said weapon targeting reticle image at least in part comprises said inner region and includes the weapon targeting marker.

6. The method of claim 1 further including controlling the direction of the progressive panning based at least in part on the position of the weapon targeting marker relative to a reference point.

7. The method of claim 6 wherein the reference point comprises the center of the display.

10. The method of claim 1 further including dynamically resizing and relocating the outer region and the inner region in response to user input.

11. The method of claim 10 wherein the outer region and the inner region are dynamically resizable and re-locatable based on the displayed position of a targeting reticle on the display.

12. The method of claim 1 further comprising operating in a user-selectable view lock mode that causes the viewpoint to remain stationary regardless of the position of the marker.

15. The method of claim 1 wherein said moving comprises moving the marker in response to the user changing the aiming direction of a handheld pointing device, including sensing said aiming direction with at least one of an optical sensor and an accelerometer.

16. The method of claim 1 wherein said progressively panning controls the rate of panning based on weapon targeting marker position within the outer region.

8. A system for providing an animated display comprising:

a display device that displays an image subdivided into a plurality of regions including at least a panning region and a free weapon targeting marker movement region;

a weapon targeting unit that displays a weapon targeting marker at a position on said display device to target objects for damage or destruction by a virtual weapon;

a user input device configured to communicate with said weapon targeting unit, said user input device determining the position said weapon targeting marker is displayed on said display device and thereby allowing a user to control targeting of objects for damage or destruction by said virtual weapon; and

a panning unit that maintains a 3-D viewpoint at a stationary location in response to the position of the weapon targeting marker being within the free weapon targeting marker movement region, the panning unit selectively simultaneously progressively panning the 3-D viewpoint to display a continually changing subset of a 3D world to simulate panning of a camera or turning the user'"'"'s head, while said weapon targeting marker continues at the same time to target objects conditioned on which of said regions said weapon targeting marker is displayed within.

13. The system of claim 8 wherein the plurality of panning regions and the free weapon targeting movement region are dynamically resizable and re-locatable in relation to the position of the weapon targeting marker on the display device.

17. The system of claim 8 further including controlling the speed of said panning based at least in part on the position of said weapon targeting marker on the display.

9. A non-transitory computer readable medium having computer-readable instructions for performing a method comprising:

defining a model of a three-dimensional world including objects that can be targeted by a virtual weapon;

providing a virtual camera to view the three-dimensional world with panning control that when activated pans the virtual camera within the three-dimensional world to expose additional said objects to view, and when deactivated keeps the virtual camera stationary within the three-dimensional world;

subdividing a display region for viewing the three-dimensional world into at least first and second regions, said three-dimensional world being viewable through each of said first and second regions;

controlling a position a targeting reticle is displayed in response to a user providing inputs to allow the user to selectively target said objects;

activating the panning control of the virtual camera whenever said user positions the targeting reticle within the first region, thereby causing said targeting reticle to simultaneously target objects and control progressive smooth panning of said three-dimensional viewpoint to expose continually changing portions of the three-dimensional world to display; and

deactivating the panning control of the virtual camera in response to movement of the targeting reticle whenever the user positions said targeting reticle within the second region different from said first region to allow the user to continue to control the targeting reticle to target objects without changing the viewpoint.

14. The non-transitory computer readable medium of claim 9 wherein the at least first and second regions are dynamically resizable and re-locatable in relation to the position of the targeting reticle on the display.

18. The non-transitory computer readable medium of claim 9 wherein said panning being at a rate that is responsive to position of the targeting reticle.