Three-dimensional-model processing apparatus, three-dimensional-model processing method, and computer program

• US 20050024360A1
• Filed: 07/06/2004
• Published: 02/03/2005
• Est. Priority Date: 07/18/2003
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Abe, Yuichi, Segawa, Hiroyuki, Yoshioka, Akio
• Granted Patent: US 7,536,655 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

Three-dimensional-model processing apparatus, three-dimensional-model processing methods, and computer programs are provided. In a three-dimensional-model processing apparatus, method, and computer programs, it is determined whether relative positions or relative attitudes of a plurality of three-dimensional objects shown on an image display unit satisfy a predetermined processing execution condition. When it is determined that the processing execution condition is satisfied, distinction information indicating that processing such as pickup or joining of objects is possible is presented. For example, display mode is changed or sound is output for the objects. A user is allowed to immediately find without stress whether an object is at a position where pickup or joining is possible. This improves the efficiency of operation.

Claims

1. A three-dimensional-model processing apparatus for displaying three-dimensional objects on a display and for executing processing relating to the displayed objects based on information input from input means, the three-dimensional-model processing apparatus comprising:

a three-dimensional information measuring unit for measuring three-dimensional information of operating devices;

a display-information controlling unit for controlling display of three-dimensional objects associated with the operating devices, based on the three-dimensional information of the operating devices and input from the three-dimensional-information measuring unit; and

an image display unit for displaying an image including the three-dimensional objects associated with the operating devices, under control of the display-information controlling unit;

wherein the display-information controlling unit determines whether relative positions or relative attitudes of a plurality of three-dimensional objects satisfy a predetermined processing execution condition, and executes processing for presenting distinction information to indicate that processing can be executed when it is determined that the processing execution condition is satisfied.

2. The three-dimensional-model processing apparatus according to claim 1, wherein the processing execution condition is a condition that is set based on a three-dimensional distance, in a virtual space, between the plurality of three-dimensional objects displayed on the image display unit.

3. The three-dimensional-model processing apparatus according to claim 1, wherein the processing execution condition is a condition that is set based on relative tilts defining attitudes of the plurality of three-dimensional objects displayed on the image display unit.

4. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit dynamically changes the processing execution condition based on precision or resolution of measurement of three-dimensional information in the three-dimensional-information measuring unit.

5. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit, as the processing for presenting distinction information, executes processing for changing display mode so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

6. The three-dimensional-model processing apparatus according to claim 5, wherein the processing for changing display mode changes at least one attribute among color, size, shape, and motion, of at least one element among surface, line, and vertex of the three-dimensional object.

7. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit, as the processing for presenting distinction information, executes processing for outputting sound so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

8. The three-dimensional-model processing apparatus according to claim 1, wherein the processing execution condition is a condition for executing processing for picking up an object, and wherein the display-information controlling unit determines whether relative positions or relative attitudes of a plurality of three-dimensional objects displayed on the image display unit satisfy a predetermined condition for executing the processing for pickup, and executes the processing for presenting distinction information to indicate that the processing for pickup can be executed when it is determined that the condition for executing the processing for pickup is satisfied.

9. The three-dimensional-model processing apparatus according to claim 1, wherein the processing execution condition is a condition for executing processing for joining an object, and wherein the display-information controlling unit determines whether relative positions or relative attitudes of a plurality of three-dimensional objects displayed on the image display unit satisfy a predetermined condition for executing the processing for joining, and executes the processing for presenting distinction information to indicate that the processing for joining can be executed when it is determined that the condition for executing the processing for joining is satisfied.

10. The three-dimensional-model processing apparatus according to claim 9, wherein the display-information controlling unit, as the processing for presenting distinction information to indicate that the processing for joining objects can be executed, executes processing for displaying a virtual joining region showing a state after joining.

11. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit generates a new object and displays the new object on the image display unit based on input information indicating that one of the operating devices is located in proximity to a position of a real object, the position being set in the three-dimensional-information measuring unit.

12. The three-dimensional-model processing apparatus according to claim 1, wherein, based on input information indicating that one of the operating devices is located in proximity to a position of a real object for network connection, the position being set in the three-dimensional-information measuring unit, processing for communication is executed to send information of an object displayed on the image display unit, the object being associated with the one operating device, to an external apparatus connected via a network, and to display the object in a three-dimensional image provided by the external apparatus.

13. The three-dimensional-model processing apparatus according to claim 12, wherein processing for communication is executed to send a program or program-specifying information defining operation of the object associated with the one operating device together with the object information to the external apparatus connected via the network, the operation being set in accordance with composition information of the object, and to display the object in the three-dimensional image provided by the external apparatus so that the object operates in accordance with the composition information of the object.

14. A three-dimensional-model processing method for displaying three-dimensional objects on a display and for executing processing relating to the displayed objects based on information input from input means, the three-dimensional-model processing method comprising:

measuring step of measuring three-dimensional information of operating devices;

controlling display-information on an image display unit, of three-dimensional objects associated with the operating devices, based on the three-dimensional information of the operating devices, measured in the three-dimensional-information measuring step; and

displaying, on the image display unit, an image including the three-dimensional objects associated with the operating devices, under control in the display-information controlling step;

wherein controlling display-information comprises determining whether relative positions or relative attitudes of a plurality of three-dimensional objects satisfy a predetermined processing execution condition, and executing processing for presenting distinction information to indicate that processing can be executed when it is determined that the processing execution condition is satisfied.

15. The three-dimensional-model processing method according to claim 14, wherein the processing execution condition is a condition that is set based on a three-dimensional distance, in a virtual space, between the plurality of three-dimensional objects displayed on the image display unit.

16. The three-dimensional-model processing method according to claim 14, wherein the processing execution condition is a condition that is set based on relative tilts defining attitudes of the plurality of three-dimensional objects displayed on the image display unit.

17. The three-dimensional-model processing method according to claim 14, wherein controlling display-information comprises dynamically changing the processing execution condition based on precision or resolution of measurement of three-dimensional information in the three-dimensional-information measuring step.

18. The three-dimensional-model processing method according to claim 14, wherein controlling display-information comprises, as the processing for presenting distinction information, executing processing for changing display mode so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

19. The three-dimensional-model processing method according to claim 18, wherein the processing for changing display mode changes at least one attribute among color, size, shape, and motion, of at least one element among surface, line, and vertex of the three-dimensional objects.

20. The three-dimensional-model processing method according to claim 14, wherein controlling display-information comprises, as the processing for presenting distinction information, a step of executing processing for outputting sound so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

21. The three-dimensional-model processing method according to claim 14, wherein the processing execution condition is a condition for executing processing for picking up an object, and wherein controlling display-information comprises determining whether relative positions or relative attitudes of a plurality of three-dimensional objects displayed on the image display unit satisfy a predetermined condition for executing the processing for pickup, and executing the processing for presenting distinction information to indicate that the processing for pickup can be executed when it is determined that the condition for executing the processing for pickup is satisfied.

22. The three-dimensional-model processing method according to claim 14, wherein the processing execution condition is a condition for executing processing for joining objects, and wherein controlling display-information comprises determining whether relative positions or relative attitudes of a plurality of three-dimensional objects displayed on the image display unit satisfy a predetermined condition for executing the processing for joining, and executing the processing for presenting distinction information to indicate that the processing for joining can be executed when it is determined that the condition for executing the processing for joining is satisfied.

23. The three-dimensional-model processing method according to claim 22, wherein controlling display-information comprises, as the processing for presenting distinction information to indicate that the processing for joining objects can be executed, a step of executing processing for displaying a virtual joining region showing a state after joining.

24. The three-dimensional-model processing method according to claim 14, wherein the controlling display-information comprises generating a new object and displaying the new object on the image display unit based on input information indicating that one of the operating devices is located in proximity to a position of a real object, the position being set in the three-dimensional-information measuring unit.

25. The three-dimensional-model processing method according to claim 14, wherein, based on input information indicating that one of the operating devices is located in proximity to a position of a real object for network connection, the position being set in the three-dimensional-information measuring unit, processing for communication is executed to send information of an object displayed on the image display unit, the object being associated with the one operating device, to an external apparatus connected via a network, and to display the object in a three-dimensional image provided by the external apparatus.

26. The three-dimensional-model processing method according to claim 25, wherein processing for communication is executed to send a program or program-specifying information defining operation of the object associated with the one operating device together with the object information to the external apparatus connected via the network, the operation being set in accordance with composition information of the object, and to display the object in the three-dimensional image provided by the external apparatus so that the object operates in accordance with the composition information of the object.

27. A computer program for displaying three-dimensional objects on a display and for executing processing relating to the displayed objects based on information input from input means, the computer program comprising:

a three-dimensional information measuring step of measuring three-dimensional information of operating devices;

a display-information controlling step of controlling display, on an image display unit, of three-dimensional objects associated with the operating devices, based on the three-dimensional information of the operating devices, measured in the three-dimensional-information measuring step; and

an image display step of displaying, on the image display unit, an image including the three-dimensional objects associated with the operating devices, under control in the display-information controlling step;

wherein the display-information controlling step comprises determining whether relative positions or relative attitudes of a plurality of three-dimensional objects satisfy a predetermined processing execution condition, and executing processing for presenting distinction information to indicate that processing can be executed when it is determined that the processing execution condition is satisfied.