User controlled graphics object movement based on amount of joystick angular rotation and point of view angle

• US 6,917,356 B1
• Filed: 10/12/2000
• Issued: 07/12/2005
• Est. Priority Date: 10/09/1995
• Status: Expired due to Fees

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Koshima, Kazuo, Miyamoto, Shigeru, Nishiumi, Satoshi, Nishida, Yasunari
• Primary Examiner(s): Liang, Regina
• Application Number:
  US09/686,761
• Time in Patent Office: 1,734 Days
• Field of Search: 345/161, 345/419, 345/427, 345/474, 345/953, 345/418, 345/428, 463/32, 463/33, 463/34, 463/35, 463/36
• US Class Current: 345/161
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/577 using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars
• CPC Class Codes: A63F 13/95 Storage media specially adapted for storing game information, e.g. video game cartridges
• CPC Class Codes: A63F 2300/1018 Calibration; Key and button assignment
• CPC Class Codes: A63F 2300/1025 details of the interface with the game device, e.g. USB version detection
• CPC Class Codes: A63F 2300/1037 being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
• CPC Class Codes: A63F 2300/1043 being characterized by constructional details
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/206 Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/63 for controlling the execution of the game in time
• CPC Class Codes: A63F 2300/636 involving process of starting or resuming a game
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/643 : by determining the impact between objects, e.g. collision detection
• CPC Class Codes: A63F 2300/66 : for rendering three dimensional images
• CPC Class Codes: A63F 2300/6653 : for altering the visibility of an object, e.g. preventing the occlusion of an object, partially hiding an object
• CPC Class Codes: A63F 2300/6661 : for changing the position of the virtual camera
• CPC Class Codes: A63F 2300/8005 : Athletics
• CPC Class Codes: A63F 2300/8035 : Virtual fishing
• CPC Class Codes: A63F 2300/807 : Role playing or strategy games
• CPC Class Codes: G05G 2009/0474 : characterised by means converting mechanical movement into electric signals
• CPC Class Codes: G05G 2009/04748 : Position sensor for rotary movement, e.g. potentiometer
• CPC Class Codes: G05G 2009/04759 : Light-sensitive detector, e.g. photoelectric
• CPC Class Codes: G05G 2009/04777 : with additional push or pull action on the handle
• CPC Class Codes: G05G 9/047 : the controlling member being movable by hand about orthogonal axes, e.g. joysticks for switches H01H25/04
• CPC Class Codes: G06F 11/20 : using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
• CPC Class Codes: G06F 2203/013 : Force feedback applied to a game
• CPC Class Codes: G06F 2203/015 : Force feedback applied to a joystick
• CPC Class Codes: G06F 2203/0382 : Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/038 : Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0383 : Signal control means within the pointing device
• CPC Class Codes: G06T 15/10 : Geometric effects
• CPC Class Codes: G06T 15/20 : Perspective computation

Abstract

Three-dimensional image display game system and method for use with a display for displaying an object in a three-dimensional space, including an operation controlling device including an operating member having a base end rotatably supported and a free end operable by an operator. The operation controlling device includes an inclination amount data output detector which detects an inclination amount of the operating member to output inclination amount data. The system further includes direction determining circuitry operable to determine a direction that corresponds to an inclination direction of the operating member based on the inclination amount data, and moving object direction determining circuitry which determines a moving direction of the object in three-dimensional space based upon the direction determined by the direction determining circuitry and a point of view angle at which the object is being viewed by the operator in three-dimensional space. A direction in which the operating member must be moved to cause forward movement of the object is offset from a forward direction of the operation controlling device by an angle corresponding to the point of view angle.

Claims

1. A three-dimension image processing system, including an image processing apparatus connected to a display to generate image data for displaying an object existing in a three-dimensional space on said display according to a program, and an operating device including an operating member having a base end rotatably supported and a free end operable by an operator, so that the image data is varied in accordance with movement of said operating member,

wherein said operating device includes an inclination amount circuitry which detects an inclination amount of said operating member to output inclination amount data, and

wherein said image processing apparatus comprises:

direction determining circuitry which determines a moving direction of the object in the three-dimensional space based on the inclination amount data and a camera angle at which the object is being viewed by said operator at a time when the inclination amount is detected;

moving amount determining circuitry which determines a moving amount of the object on said display;

position determining circuitry which determines a position of the object in the three-dimensional space in accordance with the moving direction and the moving amount; and

an image data output circuitry which outputs image data for displaying the object on said display at a position controlled by said position determining circuitry.

2. A three-dimension image processing system according to claim 1, wherein said moving amount determining circuitry includes a first calculating circuitry that calculates the moving amount based on the inclination amount data, a moving amount storage that stores a previous actual moving amount of the object, comparing circuitry that compares the actual moving amount in said moving amount storage with the moving amount calculated by said first calculating circuitry, and moving amount varying circuitry that increases and decreases the moving amount calculated by said first calculating circuitry dependent on a result of comparison by said comparing circuitry.

3. A three-dimension image processing system according to claim 2, wherein said first calculating circuitry calculates from the inclination amount data a moving amount which together with a predetermined value are calculated into the moving amount.

4. A three-dimension image processing system according to claim 2, wherein said moving amount varying circuitry means increases and decreases the moving amount in accordance with a function of the moving amount in said moving amount storage.

5. A three-dimension image processing system according to claim 2, wherein said moving amount varying circuitry increases and decreases the moving amount in accordance with a constant value.

6. A three-dimension image processing system according to claim 1, wherein said moving direction determining circuitry includes second calculating circuitry that calculates the inclining direction of said operating member based on the inclination amount data.

7. In a three-dimension image processing system including an image processing apparatus connected to a display to generate image data for displaying an object existing in a three-dimensional space on said display, and an operating device including an operating member having a base end rotatably supported, a free end operable by an operator, and inclination amount data output circuitry which detects an inclination amount of said operating device to output inclination amount data, so that the image data is varied depending on movement of said operating member, wherein a program storing medium is stored with a program for generating the image data, said program being adapted to perform the steps of:

(a) determining a moving direction of the object in the three-dimensional space based on the inclination amount data and a camera angle at which the object is being viewed by an operator;

(b) determining a moving amount of the object to be moved within one frame on said display based on the inclination amount;

(c) determining a position of the object in the three-dimensional space depending on the moving direction and the moving amount; and

(d) outputting the image data for displaying the object at the position thus determined in step (c).

8. A program storing medium according to claim 7, wherein said image processing apparatus includes a storage that stores an actual moving amount of the object, and said program is adapted for (d1) determining the moving amount based on the inclination amount data, (d2) comparing the actual moving amount stored in said with the determined moving amount, and increasing and decreasing the determined moving amount depending on the comparing result.

9. A program storing medium according to claim 8, wherein said program is adapted for determining the moving amount from a moving amount which is calculated based on the inclination amount data and a predetermined value.

10. A program storing medium according to claim 8, wherein said program is adapted for increasing and decreasing the determined moving amount in accordance with a function of moving amount stored in said moving amount storage.

11. A program storing medium according to claim 8, wherein said program is adapted for increasing and decreasing the determined moving amount in accordance with constant value.