Apparatus for controlling the shift of virtual space and method and program for controlling same

• US 7,477,243 B2
• Filed: 05/29/2003
• Issued: 01/13/2009
• Est. Priority Date: 05/31/2002
• Status: Expired due to Fees

• Current Assignee: Minato Advanced Technologies Inc. (Minato Holdings Inc.), Xiroku, Inc.
• Original Assignee: EIT Co. Ltd. (Minato Holdings Inc.), Xiroku, Inc.
• Inventors: Ogawa, Yasuji, Shimiya, Kouki, Sakai, Jun
• Primary Examiner(s): Dharia; Prabodh M.
• Application Number:
  US10/447,828
• Publication Number:
  US 20040051709A1
• Time in Patent Office: 2,056 Days
• Field of Search: 345/204, 345/420, 345/621, 345/173, 345/184, 345/419, 345/438, 345/433, 345/672, 345473-475, 345/629, 345/630, 345/168, 345156-158, 345418-422, 348/208.1, 348/36, 348/51, 463/31, 463/32, 715/738, 715/782, 715/760, 715/720
• US Class Current: 345/204
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation

Abstract

A virtual-space shift control apparatus includes a detecting element that detects a touch operation or a drag operation of a pointing device having a plurality of pointing elements, performed on a display screen and a viewpoint-position information generator that generates viewpoint position information of a virtual space image based on the detected touch or drag operation of the detecting element. A three-dimensional image generator is provided that generates data on the virtual space image seen from a viewpoint indicated by the viewpoint position information and outputting a three dimensional image to the display.

Claims

1. A virtual-space shift control apparatus, comprising:

a display having a display area on which a virtual space image is displayed;

a detecting element that optically detects a touch operation or a drag operation of a pointing device having a plurality of pointing elements, performed on the display;

a viewpoint-position information generator that generates viewpoint position information of the virtual space image based on the optically detected touch or drag operation of the detecting element; and

a three-dimensional image generator that generates data on the virtual space image seen from a viewpoint indicated by the viewpoint position information and outputting a three-dimensional virtual image to the display, said display simultaneously displaying a virtual plane formed of a two-dimensional view of said virtual image and said three-dimensional virtual image.

2. A virtual-space shift control apparatus, comprising:

an operation detecting element that optically detects a plurality of pointing elements of a pointing device and respective touch positions of the plurality of pointing elements, the pointing device performing a touch operation or a drag operation on a prescribed display area on which a virtual space image is displayed;

an information control section that generates viewpoint shift information for shifting a viewpoint of the virtual space image based on the plurality of pointing elements and the respective touch positions of the plurality of pointing elements and outputting viewpoint shift information to be displayed; and

a display that displays the virtual space image based on the viewpoint shift information outputted from the information control section, said display displaying a virtual plane formed of a two-dimensional virtual image and a virtual space formed of a three-dimensional image simultaneously.

3. The virtual-space shift control apparatus according to claim 2, wherein the information control section generates the viewpoint shift information for shifting a position of the viewpoint to the touch position based on a position of the touch operation by one of the plurality of pointing elements.

4. The virtual-space shift control apparatus according to claim 2, wherein the information control section receives time-series data of a distance and a direction from a starting point to an end point of the drag operation by one of the plurality of pointing elements and generates the viewpoint shift information for shifting the viewpoint based on the time-series data of the distance and the direction from the starting point toward the end point.

5. The virtual-space shift control apparatus according to claim 2, wherein

a viewpoint icon for the virtual space, which is displayed in the virtual plane, receives time-series data of a distance and a direction from a starting point to an end point of the drag operation by one of the plurality of pointing elements, and the information control section generates the viewpoint shift information for shifting the viewpoint in the virtual space based on the time-series data of the distance and the direction from the starting point to the end point of the drag operation.

6. The virtual-space shift control apparatus according to claim 2, wherein

a viewing angle icon for the viewpoint in the virtual space, which is displayed in the virtual plane, receives data of a turning angle of the drag operation by one of the plurality of pointing elements, and the information control section generates the viewpoint shift information for turning the viewing angle icon by the turning angle.

7. The virtual-space shift control apparatus according to claim 2, wherein the information control section receives data of a distance and a direction from a first touch position of an initial touch operation to a second touch position of a next touch operation, and generates viewpoint shift information for shifting the viewpoint based on the distance and the direction from the first touch position to the second touch position.

8. The virtual-space shift control apparatus according to claim 7, wherein the information control section determined a position of a split point at which a line connecting the first touch position and the second touch position in a designated proportion based on the first touch position and the second touch position, and generates the viewpoint shift information for changing a speed or an acceleration at which the viewpoint is shifted, based on time-series changes of the position of the split point.

9. The virtual-space shift control apparatus according to claim 2, wherein

the information control section receives time-series data of a distance between touch positions by two of the plurality of pointing elements, and generates scale information for enlarging or reducing the virtual plane based on time-series changes of the distance between the touch positions by the two pointing elements.

10. The virtual-space shift control apparatus according to claim 2, wherein the information control section receives time-series data on a position of a central point of first to n^th touch positions, and generates the viewpoint shift information for shifting the viewpoint based on the time-series changes of the position of the central point of the first to n^th touch positions.

11. The virtual-space shift control apparatus according to claim 2, wherein

the display displays an operation icon for operating the viewpoint in the virtual space;

and

the information control section receives time-series data of a distance and a direction from a starting point to an end point of the drag operation of a drag section of the operation icon, and generates viewpoint shift information for shifting the viewpoint based on time-series changes of the distance and the direction from the starting point to the end point.

12. A virtual-space shift control method comprising:

optically detecting a touch operation or a drag operation of a pointing device having a plurality of pointing elements, which is performed on a display screen;

generating viewpoint position information of a virtual space image based on the optically detected touch or drag operation; and

generating a three-dimensional image for generating data on the virtual space image seen from a viewpoint indicated by the viewpoint position information and outputting it to the display, said display simultaneously displaying a virtual plane formed of a two-dimensional view of said virtual image and said three-dimensional virtual image.

13. A virtual-space shift control method comprising:

optically detecting a plurality of pointing elements of a pointing device and respective touch positions of the plurality of pointing elements, the pointing device performing a touch operation or a drag operation on a prescribed display area on which a virtual space image is displayed;

generating viewpoint shift information for shifting a viewpoint on the virtual space image based on the plurality of pointing elements and the respective touch positions of the pointing elements, and outputting the shifted virtual space image to the display; and

displaying the virtual space image based on the viewpoint shift information;

displaying a virtual plane formed of a two-dimensional virtual image and a virtual space formed of a three-dimensional virtual image simultaneously.

14. The virtual-space shift control method according to claim 13, further comprising generating the viewpoint shift information or shifting a position of the viewpoint to a touch position, based on a position of the touch operation by one of the plurality of pointing elements.

15. The virtual-space shift control method according to claim 13, further comprising receiving time-series data on a distance and a direction from a starting point to an end point of the drag operation by one of the plurality of pointing elements, and generating the viewpoint shift information for shifting the viewpoint in the virtual space image based on the time-series data on the distance and the direction from the starting point to the end point.

16. The virtual-space shift control method according to claim 13, further comprising:

displaying a virtual plane formed of a two-dimensional virtual image and a virtual space formed of a three-dimensional virtual image simultaneously;

displaying a viewpoint icon for the virtual space in the virtual plane that receives time-series data on a distance and a direction from a starting point to an end point of the drag operation by one of the plurality of pointing elements; and

generating the viewpoint shift information for shifting the viewpoint in the virtual space based on the time-series data on the distance and the direction from the starting point to the end point of the drag operation.

17. The virtual-space shift control method according to claim 13, further comprising:

displaying in the virtual plane, a viewing angle icon for the viewpoint in the virtual space;

receiving data on a turning angle of the drag operation by one of the plurality of pointing elements; and

generating the viewpoint shift information for turning a viewing angle by the turning angle.

18. The virtual-space shift control method according to claim 17, further comprising:

receiving data on a distance and a direction from a first touch position of an initial touch operation to a second touch position of a next touch operation; and

generating the viewpoint shift information for shifting the viewpoint based on the distance and the direction from the first touch position to the second touch position.

19. The virtual-space shift control method according to claim 18, further comprising:

determining a position of a split point at which a line connecting the first touch position and the second touch position is split in a designated proportion based on the first touch position and the second touch positions and generating the viewpoint shift information for changing a speed or an acceleration at which the viewpoint is shifted, based on time-series changes of the position of the split point.

20. The virtual-space shift control method according to claim 13, further comprising:

receiving time-series data on a distance between the touch positions by two of the plurality of pointing elements; and

generating scale information for enlarging or reducing the virtual plane based on time-series data on the distance between the touch positions by the two pointing parts.

21. The virtual-space shift control method according to claim 13, further comprising:

receiving time-series data on a position of a central point of first to n^th touch positions; and

generating viewpoint shift information for shifting the viewpoint based on time-series changes of the position of the central point of the first to n^th touch positions.

22. The virtual-space shift control method according to claim 13, wherein further comprising:

displaying an operation icon for operating the viewpoint in the virtual space image;

receiving time-series data on a distance and a direction from a starting point to an end point of the drag operation of a drag section of the operation icon; and

generating viewpoint shift information for shifting the viewpoint based on the time-series changes of the distance and the direction from the starting point to the end point.

23. A program used as a virtual-space shift control apparatus comprising:

a detecting element that optically detects a touch operation or a drag operation of a pointing device having a plurality of pointing elements, performed on a display screen;

a viewpoint-position information generator that generates viewpoint position information of a virtual space image based on the optically detected touch or drag operation of the detecting element; and

a three-dimensional image generator that generates data on the virtual space image seen from a viewpoint indicated by the viewpoint position information and outputting a three dimensional image to the display, said display simultaneously displaying a virtual plane formed of a two-dimensional view of said virtual image and said three-dimensional virtual image.

24. A recording medium in which a program used for executing a virtual-space shift control apparatus comprising:

a detecting element that optically detects a touch operation or a drag operation of a pointing device having a plurality of pointing elements, performed on a display screen;

a viewpoint-position information generator that generates viewpoint position information of a virtual space image based on the detected touch or drag operation of the detecting element; and

a three-dimensional image generator that generates data on the virtual space image seen from a viewpoint indicated by the viewpoint position information and outputting a three dimensional image to the display, said display simultaneously displaying a virtual plane formed of a two-dimensional view of said virtual image and said three-dimensional virtual image.