Picture display method and apparatus

• US 6,028,609 A
• Filed: 06/05/1996
• Issued: 02/22/2000
• Est. Priority Date: 06/16/1995
• Status: Expired due to Term

• Current Assignee: LINE Corporation (A Holdings Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kawakami, Itaru
• Primary Examiner(s): Fetting, Anton W.
• Application Number:
  US08/658,506
• Time in Patent Office: 1,357 Days
• Field of Search: 395/174, 395/959, 345/474, 345/959
• US Class Current: 345/474
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

A method and apparatus for displaying a three-dimensional picture is disclosed. The picture display apparatus includes a display device for displaying a three-dimensional picture, a pointing device for pointing a position in the picture displayed in the display device, a holding device for holding the control information of a plurality of possible stop points pre-determined in a three-dimensional space, and a control device for causing the three-dimensional picture to be displayed on the display device based on the control information of the possible stop points in the three-dimensional space held by the holding device. The possible stop points correspond to positions in the picture pointed by the pointing device. The producer of a virtual reality can easily reflect the intention of a three-dimensional virtual reality, while the user can easily walk in the three-dimensional virtual reality.

Claims

1. A picture display apparatus comprising:

display means for displaying a three-dimensional picture having a plurality of pre-determined selection areas;

pointing means for pointing to a position in the picture displayed on said display means and selecting one of the plurality of pre-determined selection areas;

holding means for holding control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points; and

control means for causing said display means to display the three-dimensional picture from a moving perspective, wherein the moving perspective begins at a first perspective of a first stop point and moves to a second perspective of the stop point associated with the selected selection area, and wherein the moving perspective follows a pre-determined path so that selecting one of the plurality of pre-determined selection areas for any length of time causes the perspective to move a pre-determined distance in a pre-determined direction.

2. The picture display apparatus as claimed in claim 1, wherein the control information on the possible stop points held by said holding means at least includes operation information representing a state of operations performed by the user at said possible stop points.

3. The picture display apparatus as claimed in claim 1, wherein the control information on the possible stop points held by said holding means at least includes line of sight information representing a direction of the line of sight at said possible stop points.

4. The method of claim 1 wherein the selection of one of the plurality of pre-determined selection area causes the viewpoint to automatically move a pre-determined distance within the three-dimensional picture.

5. A picture display apparatus comprising:

display means for displaying a three-dimensional picture having a plurality of pre-determined selection areas;

pointing means for pointing to a position in the picture displayed on said display means and selecting one of the plurality of pre-determined selection areas;

holding means for holding control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space wherein the control information on the possible stop points at least includes operation information representing a state of operations performed by the user at said possible stop points, and line of sight information representing a direction of the line of sight at said possible stop points, and wherein said line of sight information further includes a rolling angle of the line of sight at said possible stop points, and wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points; and

control means for causing said display means to display the three-dimensional picture from a perspective of the stop point associated with the selected selection area.

6. A picture display apparatus comprising:

display means for displaying a three-dimensional picture having a plurality of predetermined selection areas;

pointing means for pointing to a position in the picture displayed on said display means and selecting one of the plurality of pre-determined selection areas;

holding means for holding control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space, wherein the control information on the possible stop points at least includes operation information representing a state of operations performed by the user at said possible stop points, and line of sight information representing a direction of the line of sight at said possible stop points, and wherein the line of sight information further includes information representing an angle of visibility of the user at said possible stop points, wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points; and

control means for causing said display means to display the three-dimensional picture from a perspective of the stop point associated with the selected selection area.

7. A picture display apparatus comprising:

display means for displaying a three-dimensional picture having a plurality of pre-determined selection areas;

pointing means for pointing to a position in the picture displayed on said display means and selecting one of the plurality of pre-determined selection areas;

holding means for holding control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space wherein the control information at least includes speed information representing a movement speed at said possible stop points and wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points; and

control means for causing said display means to display the three-dimensional picture from a perspective of the stop point associated with the selected selection area.

8. A picture display apparatus comprising:

display means for displaying a three-dimensional picture having a plurality of pre-determined selection areas;

pointing means for pointing to a position in the picture displayed on said display means and selecting one of the plurality of pre-determined selection areas;

holding means for holding control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space wherein each of the plurality of predetermined selection areas is associated with one of the plurality of possible stop points and wherein the control information includes predetermined pass points between a first possible stop point and a second possible stop point, and wherein said control means manages control so that, if said pass point is provided in a path of movement from the first possible stop point to the second possible stop point, said pass point is passed through, said control means causing a three-dimensional picture on said display means based on the control information on said pass points; and

control means for causing said display means to display the three-dimensional picture from a perspective of the stop point associated with the selected selection area.

9. The picture display apparatus as claimed in claim 8, wherein said control means calculates points other than said plural possible stop points and said pass points by interpolation.

10. A picture display method comprising:

displaying a three-dimensional picture on a display device having a plurality of pre-determined selection areas;

receiving a selection of one of the pre-determined selection areas from a pointing device wherein the selected selection area has associated therewith a stop point; and

displaying the three-dimensional picture on said display device based on control information associated with the stop point, wherein the control information at least includes line of sight information representing a direction of the line of sight at the selected stop point, and said line of sight information further includes a rolling angle of the line of sight at the selected stop point.

11. A picture display method comprising:

displaying a three-dimensional picture on a display device having a plurality of pre-determined selection areas;

receiving a selection of one of the pre-determined selection areas from a pointing device wherein the selected selection area has associated therewith a stop point; and

displaying the three-dimensional picture on said display device based on control information associated with the stop point, wherein the control information at least includes line of sight information representing a direction of the line of sight at the selected stop point; and

the line of sight information further includes information representing an angle of visibility of the user at the selected stop point.

12. A picture display method comprising:

displaying a three-dimensional picture on a display device having a plurality of pre-determined selection areas;

receiving a selection of one of the pre-determined selection areas from a pointing device wherein the selected selection area has associated therewith a stop point; and

displaying the three-dimensional picture on said display device based on control information associated with the stop point wherein the control information at least includes speed information representing a movement speed at the selected stop point.

13. A picture display method comprising:

displaying a three-dimensional picture on a display device having a plurality of pre-determined selection areas;

receiving a selection of one of the pre-determined selection areas from a pointing device wherein the selected selection area has associated therewith a stop point; and

displaying the three-dimensional picture on said display device based on control information associated with the stop point wherein, predetermined pass points are provided between a first possible stop point and a second possible stop point, said pass point is passed through during movement from said first possible stop point to said second possible stop point, and wherein the three dimensional picture is displayed on said display means based on the control information for said pass points held by said holding means.

14. The picture display method as claimed in claim 13, wherein points other than said plural possible stop points and said pass points are calculated by interpolation.

15. A computer network configured to provide graphical data to a computer and to receive requests from the computer comprising:

a video server operationally coupled with a network and configured to provide graphical data to a computer over the network wherein the graphical data includes a plurality of viewpoints within a three-dimensional virtual reality and a plurality of discrete selection areas, wherein each of the plurality of discrete selection areas is associated with at least one of the plurality of viewpoints and, wherein the discrete seletion areas include a left arrow pointer, a right arrow pointer, a forward arrow pointer, and a zoom-back pointer; and

a management server operationally coupled with the video server and the network and configured to receive requests from the computer and to provide the graphical data in response to the requests; and

a computer configured to receive the graphical data from the video server and to provide requests to the management server, wherein the computer comprises;

a display configured to show a picture wherein the picture is based upon a first one of the plurality of viewpoints and includes at least one of the plurality of discrete selection areas; and

a pointing device operationally coupled with the display wherein, when the pointing device actuates one of the discrete selection areas, the display shows a picture based upon a viewpoint associated with the actuated discrete selection area, wherein the viewpoint associated with the activated discrete selection area is a pre-determined distance from the first one of the plurality of viewpoints; and

a network operationally coupled with the computer, the video server and the management server wherein the network transmits the graphical data and the requests.

16. The apparatus of claim 15, wherein the viewpoints comprise dwell points and pass points, wherein the pass points are arranged along a path between a first and a second dwell point and are used to provide a moving picture as the display changes from showing a first picture based upon the first dwell point and a second picture based upon the second dwell point.

17. A picture display apparatus comprising:

display configured to display a three-dimensional picture;

pointing device configured to point to a position in the picture displayed in said display;

holding memory configured to store the control information of a plurality of possible stop points pre-determined in a three-dimensional space, wherein the control information on the possible stop points held by said holding means at least includes the line of sight information representing the direction of the line of sight at said possible stop points, and wherein said line of sight information further includes the rolling angle of the line of sight at said possible stop points; and

control circuit configured to cause the three-dimensional picture to be displayed on said display based on said control information of the possible stop points in the three-dimensional space held by said holding memory, said possible stop points corresponding to positions in said picture pointed to by said pointing device.

18. A picture display apparatus comprising:

display configured to display a three-dimensional picture;

pointing device configured to point to a position in the picture displayed in said display;

holding memory configured to store the control information of a plurality of possible stop points pre-determined in a three-dimensional space, wherein the control information on the possible stop points held by said holding means at least includes the line of sight information representing the direction of the line of sight at said possible stop points, wherein the line of sight information further includes the information representing the angle of visibility of the user at said possible stop points; and

control circuit configured to cause the three-dimensional picture to be displayed on said display based on said control information of the possible stop points in the three-dimensional space held by said holding memory, said possible stop points corresponding to positions in said picture pointed to by said pointing device.

19. A picture display apparatus comprising:

display configured to display a three-dimensional picture;

pointing device configured to point to a position in the picture displayed in said display;

holding memory configured to store the control information of a plurality of possible stop points pre-determined in a three-dimensional space, wherein the control information on the possible stop points held by said holding memory at least includes the speed information representing the movement speed at said possible stop points; and

control circuit configured to cause the three-dimensional picture to be displayed on said display based on said control information of the possible stop points in the three-dimensional space held by said holding memory, said possible stop points corresponding to positions in said picture pointed to by said pointing device.

20. A picture display apparatus comprising:

display configured to display a three-dimensional picture;

pointing device configured to point to a position in the picture displayed in said display;

holding memory configured to store the control information of a plurality of possible stop points pre-determined in a three-dimensional space; and

control circuit configured to cause the three-dimensional picture to be displayed on said display based on said control information of the possible stop points in the three-dimensional space held by said holding memory, said possible stop points corresponding to positions in said picture pointed to by said pointing device, wherein said holding memory holds the control information on predetermined pass points between a first possible stop point and a second possible stop point, and wherein said control circuit manages control so that, if said pass point is provided in a path of movement from the first possible stop point to the second possible stop point, said pass point is passed through, said control circuit causing a three-dimensional picture on said display based on the control information on said pass points.

21. The picture display apparatus as claimed in claim 20 wherein said control circuit calculates points other than said plural possible stop points and said pass points by interpolation.

22. A picture display apparatus comprising:

display configurable to display a three-dimensional picture having a plurality of pre-determined selection areas;

pointing device operable to point to a position in the picture displayed on said display and selecting one of the plurality of pre-determined selection areas;

memory configurable to hold the control information of a plurality of possible stop points and a plurality of pass points, each corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space, wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points; and

a controller for causing said display to move automatically from a first perspective of a first stop point in the three-dimensional picture to a perspective of the stop point associated with the selected selection area, and wherein the first stop point and the second stop point are separated by a plurality of pass points.

23. The picture display apparatus as claimed in claim 22 wherein the control information on the possible stop points held by said memory at least includes the operation information representing the state of operations performed by the user at said possible stop points.

24. The picture display apparatus as claimed in claim 22 wherein the control information on the possible stop points held by said memory at least includes the line of sight information representing the direction of the line of sight at said possible stop points.

25. A picture display apparatus comprising:

display configurable to display a three-dimensional picture having a plurality of pre-determined selection areas;

pointing device operable to point to a position in the picture displayed on said display and selecting one of the plurality of pre-determined selection areas;

memory configurable to hold the control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points, wherein the control information on the possible stop points at least includes the line of sight information representing the direction of the line of sight at said possible stop points, and wherein said line of sight information further includes the rolling angle of the line of sight at said possible stop points; and

a controller for causing said display to display the three-dimensional picture from the perspective of the stop point associated with the selected selection area.

26. A picture display apparatus comprising:

display configurable to display a three-dimensional picture having a plurality of pre-determined selection areas;

pointing device operable to point to a position in the picture displayed on said display and selecting one of the plurality of pre-determined selection areas;

memory configurable to hold the control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points, wherein the control information on the possible stop points at least includes the line of sight information representing the direction of the line of sight at said possible stop points, and wherein the line of sight information further includes the information representing the angle of visibility of the user at said possible stop points; and

a controller for causing said display to display the three-dimensional picture from the perspective of the stop point associated with the selected selection area.

27. A picture display apparatus comprising:

display configurable to display a three-dimensional picture having a plurality of pre-determined selection areas;

pointing device operable to point to a position in the picture displayed on said display and selecting one of the plurality of pre-determined selection areas;

memory configurable to hold the control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space, wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points, and wherein the control information on the possible stop points held by said memory at least includes the speed information representing the movement speed at said possible stop points; and

a controller for causing said display to display the three-dimensional picture from the perspective of the stop point associated with the selected selection area.

28. A picture display apparatus comprising:

display configurable to display a three-dimensional picture having a plurality of pre-determined selection areas;

pointing device operable to point to a position in the picture displayed on said display and selecting one of the plurality of pre-determined selection areas;

memory configurable to hold the control information of a plurality of possible stop points corresponding to positions in the three-dimensional picture and pre-determined in a three-dimensional space wherein each of the plurality of pre-determined selection areas is associated with one of the plurality of possible stop points; and

a controller for causing said display to display the three-dimensional picture from the perspective of the stop point associated with the selected selection area, and wherein said memory holds the control information on predetermined pass points between a first possible stop point and a second possible stop point, and wherein said controller manages control so that, if said pass point is provided in a path of movement from the first possible stop point to the second possible stop point, said pass point is passed through, said controller causing a three-dimensional picture on said display means based on the control information on said pass points.

29. The picture display apparatus as claimed in claim 28 wherein said controller calculates points other than said plural possible stop points and said pass points by interpolation.