Video game system for capturing images and applying the captured images to animated game play characters

• US 6,677,967 B2
• Filed: 02/21/2001
• Issued: 01/13/2004
• Est. Priority Date: 11/20/1997
• Status: Expired due to Term

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Endo, Takashi, Matsuoka, Hirofumi, Sawano, Takao
• Primary Examiner(s): Cabeca, John
• Assistant Examiner(s): BAUTISTA, XIOMARA L
• Application Number:
  US09/788,574
• Publication Number:
  US 20010006391A1
• Time in Patent Office: 1,056 Days
• Field of Search: 345/419, 345/425, 345/430-434, 345/626, 345/636, 345/646, 345/716, 345/762, 345/764, 345/765, 345/839, 345/848, 348/576, 348/584, 348/586, 348/589, 358/906, 358/909.1, 463/31-34
• US Class Current: 715/839
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

A frame of still picture data is captured at an instant specified by a user from video signals supplied from a given video source, such as a television receiver, a video camera, etc., and the image data is displayed. When the user specifies an area of image to be cut out from the displayed still picture, the image data in the specified area is cut out and recorded as a cutout image. Each cutout image recorded is displayed in the form of an icon. When any of the icons is selected by the user, the corresponding cutout image data is read and pasted in a part to be changed in the original image data. Thus an image can be easily created by user'"'"'s choice.

Claims

1. In a software-controlled home video game machine system specifically designed for interactive 3D video game play, including 3D animated graphics and associated sound generation, said home video game machine system including a user-operable hand-held controller having a housing and a joystick provided thereon communicating with (i) a main processor, (ii) a 3D graphics coprocessor connected to the main processor for providing at least polygon coordinate transformation and light source processing, and (iii) at least one memory including a frame buffer communicating with the 3D graphics coprocessor, said at least one memory storing plural polygon coordinates defining surfaces of 3D animated video game characters, the home video game machine system playing interactive games based on software loaded therein, a method for allowing a video game player to create animated 3D images from captured 2D image data and interact with the animated 3D images to provide interactive game play, comprising:

(a) providing a captured 2D color image to the home video game machine system for storage into said at least one memory;

(b) allowing the video game player to select a portion of the captured 2D color image by operating the user-operable hand-held controller of the home video game machine system, the selected portion being at least temporarily stored in said at least one memory communicating with the 3D graphics coprocessor of the home video game machine system;

(c) processing, with at least one of the home video game machine system main processor or the home video game machine system 3D graphics coprocessor, the selected 2D color image portion to convert the selected 2D color image portion into a color texture;

(d) texture mapping, using the home video game machine system 3D graphics coprocessor, the color texture obtained from the processed selected 2D color image portion onto a predefined surface of a 3D video game character defined by plural polygon coordinates stored in the at least one memory communicating with the 3D graphics coprocessor; and

(e) animating and displaying, using at least the main processor and 3D graphics coprocessor, the 3D video game character having the applied color texture to provide interactive video game play in response to manipulation of the user-operable hand-held controller.

2. The method of claim 1 wherein step (a) comprises capturing live video from a camera and generating a 2D still image from said captured video and storing the 2D still image in the at least one memory communicating with the home video game machine system 3D graphics coprocessor.

3. The method of claim 1 wherein step (b) includes displaying a cutout window overlaid onto the captured image and allowing the game player operating the user-operable hand-held controller to change the position and dimensions of the cutout window so as to select a cutout portion of the captured 2D image and store the selected cutout portion in the at least one memory for application to the 3D character using the home video game machine system 3D graphics coprocessor.

4. The method of claim 1 wherein step (b) includes allowing the game player operating the user-operable hand-held controller to adjust brightness, contrast and/or tone of the captured 2D image.

5. The method of claim 1 wherein step (b) includes allowing the game player operating the user-operable hand-held controller to add or change portions of the captured 2D image.

6. The method of claim 5 wherein step (b) includes allowing the game player operating the user-operable hand-held controller to modify the nose portion of a captured 2D facial image.

7. The method of claim 5 wherein step (b) includes allowing the game player operating the user-operable hand-held controller to modify the ear portion of a captured 2D facial image.

8. The method of claim 5 wherein step (b) includes allowing the game player operating the user-operable hand-held controller to modify the hair portion of a captured 2D facial image.

9. The method of claim 1 wherein step (a) includes automatically masking off all but a facial portion of a captured 2D image so that the facial portion can be selected in step (b) and stored in the at least one memory.

10. The method of claim 1 wherein step (c) includes converting the captured 2D image to texture data and step (d) includes using the home video game machine system 3D graphics coprocessor to utilize said texture data to texture a facial portion of the 3D video game character defined by polygon data stored in the at least one memory.

11. The method of claim 1 further comprising allowing the video game player to edit to a surface of the 3D video game character other than the predetermined surface by manipulation of the user operable hand-held controller.

12. The method of claim 1 wherein the video game player is allowed to edit the predetermined surface of the 3D video game character through operation of the user-operable hand-held controller after the color texture is texture mapped onto the predefined surface of the 3D video game character.