Method and Apparatus for Controlling a Camera View into a Three Dimensional Computer-Generated Virtual Environment

• US 20110227913A1
• Filed: 05/27/2011
• Published: 09/22/2011
• Est. Priority Date: 11/28/2008
• Status: Abandoned Application

• Current Assignee: Arn Hyndman
• Original Assignee: Arn Hyndman
• Inventors: Hyndman, Arn
• Application Number:
  US13/117,382
• Publication Number:
  US 20110227913A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/6676 by dedicated player input
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 90/00 Systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not involving significant data processing
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics

Abstract

Motion sensors on a portable computing device are used to control a camera view into a three dimensional computer-generated virtual environment. This allows the user to move the portable computing device to see into the virtual environment from different angles. For example, the user may rotate the portable computing device about a vertical axis toward the left to cause the camera angle in the virtual environment to pan to the left. Likewise, rotational motion about a horizontal axis will cause the camera to move up or down to adjust the vertical orientation of the user'"'"'s view into the virtual environment. By causing the view in the virtual environment that is shown on the display to follow the movement of the portable computing device, the display of the portable computing device appears to provide a window into the virtual environment which provides an intuitive interface to the virtual environment.

Claims

1. A method of controlling a camera view into a three dimensional computer-generated virtual environment, the method comprising the steps of:

obtaining user input from one or more motion sensors incorporated into a hand-held portable computing device, the portable computing device including an integrated display;

conveying the user input to a rendering process, the rendering process being responsible for rendering the three dimensional computer-generated virtual environment; and

displaying a view into the three dimensional computer-generated virtual environment on the integrated display of the portable computing device;

wherein the user input from the one or more motion sensors is used by the rendering process to adjust a camera location and orientation used to create the view into the virtual environment that is displayed on the integrated display of the portable computing device.

2. The method of claim 1, wherein the one or more motion sensors are acceleration sensors.

3. The method of claim 1, wherein the one or more motion sensors are MEMS gyroscopes.

4. The method of claim 1, wherein the user input is movement, by the user, of the hand-held portable computing device.

5. The method of claim 4, wherein movement of the hand-held portable computing device causes the display on the hand-held portable computing device to be angled relative to a viewing position of the user, and wherein the camera location and orientation of the view into the virtual environment angularly changes a corresponding amount.

6. The method of claim 5, further comprising implementing a multiplication factor such that movement of the hand-held portable computing device to cause the display on the hand-held portable computing device to be angled at a first angle relative to a viewing position of the user will cause an angle of the camera orientation within the virtual environment to be angled a proportionate amount, the proportionate amount being determined by multiplying the multiplication factor times the first angle.

7. The method of claim 6, wherein the user may depress a button or touch an area of the display to adjust the multiplication factor.

8. The method of claim 1, further comprising enabling the user to set a default angle of view into the virtual environment.

9. The method of claim 8, wherein the user may depress a button or touch an area of the display to temporarily disable point of view control such that movement of the handheld portable computing device will not affect the camera angle into the virtual environment.

10. The method of claim 1, wherein the user may depress a button or touch an area of the display to toggle on/off whether movement of the handheld portable computing device will affect the camera orientation and location within the virtual environment.

11. The method of claim 1, wherein rotation of the portable computing device about a vertical axis will cause the camera orientation in the virtual environment to pan to the left or to the right.

12. The method of claim 1, wherein rotation of the portable computing device about a horizontal axis will cause the camera orientation in the virtual environment to tilt up or tilt down.

13. The method of claim 1, wherein longitudinal motion of the portable computing device toward or away from the user is further translated into a camera zoom action in the virtual environment.

14. The method of claim 1, wherein movement gestures of the handheld portable computing device are interpreted to control the camera within the virtual environment.

15. The method of claim 14, wherein the gestures include differences between quick movements and slow movements.

16. The method of claim 14, wherein gestures are only interpreted by the handheld portable computing device in connection with associated button pushes or screen touches.

17. The method of claim 1, wherein the step of displaying a view into the three dimensional computer-generated virtual environment on the integrated display of the portable computing device causes the view in the virtual environment that is shown on the display to follow the movement of the portable computing device such that the display of the handheld portable computing device appears to provide a window into the virtual environment.

18. The method of claim 1, further comprising the step of detecting a location of the user'"'"'s head relative to the display, and using the location of the user'"'"'s head to determine a point of view, field of view, and view plane used for rendering the virtual environment shown to the user on the display.

19. The method of claim 18, wherein the portable computing device includes a camera facing the direction of the display, and wherein the location of the user'"'"'s head is determined by the camera.