Three-dimensional-model processing apparatus, three-dimensional-model processing method, and computer program

• US 7,536,655 B2
• Filed: 07/06/2004
• Issued: 05/19/2009
• Est. Priority Date: 07/18/2003
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Abe, Yuichi, Segawa, Hiroyuki, Yoshioka, Akio
• Primary Examiner(s): Lo; Weilun
• Assistant Examiner(s): Hassan; Rashedul
• Application Number:
  US10/885,357
• Publication Number:
  US 20050024360A1
• Time in Patent Office: 1,778 Days
• Field of Search: 715/757, 715/848, 715/850, 715/852, 715/849, 715/851, 345/419, 345/653, 345/664, 345/679
• US Class Current: 715/848
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

Three-dimensional-model processing apparatus, three-dimensional-model processing methods, and computer programs are provided. In a three-dimensional-model processing apparatus, method, and computer programs, it is determined whether relative positions or relative attitudes of a plurality of three-dimensional objects shown on an image display unit satisfy a predetermined processing execution condition. When it is determined that the processing execution condition is satisfied, distinction information indicating that processing such as pickup or joining of objects is possible is presented. For example, display mode is changed or sound is output for the objects. A user is allowed to immediately find without stress whether an object is at a position where pickup or joining is possible. This improves the efficiency of operation.

Claims

1. A three-dimensional-model processing apparatus for displaying three-dimensional objects on a display and for executing processing relating to the displayed objects based on information input from input means, the three-dimensional-model processing apparatus comprising:

a three-dimensional information measuring unit for measuring three-dimensional information of operating devices wherein the three-dimensional information measuring unit comprises at least one real block object, each of the at least one real block objects represents a distinct physical property;

a display-information controlling unit for controlling display of three-dimensional objects associated with the operating devices, based on the three-dimensional information of the operating devices and input from the three-dimensional-information measuring unit; and

an image display unit for displaying an image including the three-dimensional objects associated with the operating devices, under control of the display-information controlling unit wherein one of the plurality of three-dimensional objects is generated on the image display unit when one of the plurality of operating devices is placed in contact with or in proximity to one of the plurality of real block object;

wherein the one of the plurality of three-dimensional objects display the distinct physical property of the one of the plurality of real block objects;

wherein the display-information controlling unit determines whether relative positions or relative attitudes of a plurality of three-dimensional objects satisfy a predetermined processing execution condition, and executes processing for presenting distinction information to indicate that processing can be executed when it is determined that the processing execution condition is satisfied, and wherein the processing execution condition is a condition for executing processing for picking up or joining an object, and wherein the display-information controlling unit determines whether relative positions or relative attitudes of a plurality of three-dimensional objects displayed on the image display unit satisfy a predetermined condition for executing the processing for pickup or joining, and executes the processing for presenting distinction information to indicate that the processing for pickup or joining can be executed when it is determined that the condition for executing the processing for pickup or joining is satisfied;

wherein the display-information controlling unit dynamically changes the processing execution condition based on precision or resolution of measurement of three-dimensional information in the three-dimensional-information measuring unit.

2. The three-dimensional-model processing apparatus according to claim 1, wherein the processing execution condition is a condition that is set based on a three-dimensional distance, in a virtual space, between the plurality of three-dimensional objects displayed on the image display unit.

3. The three-dimensional-model processing apparatus according to claim 1, wherein the processing execution condition is a condition that is set based on relative tilts defining attitudes of the plurality of three-dimensional objects displayed on the image display unit.

4. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit, as the processing for presenting distinction information, executes processing for changing display mode so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

5. The three-dimensional-model processing apparatus according to claim 4, wherein the processing for changing display mode changes at least one attribute among color, size, shape, and motion, of at least one element among surface, line, and vertex of the three-dimensional object.

6. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit, as the processing for presenting distinction information, executes processing for outputting sound so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

7. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit, as the processing for presenting distinction information to indicate that the processing for joining objects can be executed, executes processing for displaying a virtual joining region showing a state after joining.

8. The three-dimensional-model processing apparatus according to claim 1, wherein the display-information controlling unit generates a new object and displays the new object on the image display unit based on input information indicating that one of the operating devices is located in proximity to a position of a real object, the position being set in the three-dimensional-information measuring unit.

9. The three-dimensional-model processing apparatus according to claim 1, wherein, based on input information indicating that one of the operating devices is located in proximity to a position of a real object for network connection, the position being set in the three-dimensional-information measuring unit, processing for communication is executed to send information of an object displayed on the image display unit, the object being associated with the one operating device, to an external apparatus connected via a network, and to display the object in a three-dimensional image provided by the external apparatus.

10. The three-dimensional-model processing apparatus according to claim 9, wherein processing for communication is executed to send a program or program-specifying information defining operation of the object associated with the one operating device together with the object information to the external apparatus connected via the network, the operation being set in accordance with composition information of the object, and to display the object in the three-dimensional image provided by the external apparatus so that the object operates in accordance with the composition information of the object.

21. The three-dimensional-model processing apparatus according to claim 1, wherein the three-dimensional information measuring unit comprises a three-dimensional information calculator and a magnetic-field generator.

11. A three-dimensional-model processing method for displaying three-dimensional objects on a display and for executing processing relating to the displayed objects based on information input from input means, the three-dimensional-model processing method comprising:

measuring step of measuring three-dimensional information of operating devices wherein the measuring step includes measuring at least one real block, each of the at least one real block objects represents a distinct physical property;

controlling display-information on an image display unit, of three-dimensional objects associated with the operating devices, based on the three-dimensional information of the operating devices, measured in the three-dimensional-information measuring step; and

displaying, on the image display unit, an image including the three-dimensional objects associated with the operating devices, under control in the display-information controlling step wherein one of the plurality of three-dimensional objects is generated on the image display unit when one of the plurality of operating devices is placed in contact with or in proximity to one of the plurality of real block objects;

wherein the one of the plurality of three-dimensional objects displays the distinct physical property of the one of the plurality of real block objects;

wherein controlling display-information comprises determining whether relative positions or relative attitudes of a plurality of three-dimensional objects satisfy a predetermined processing execution condition, and executing processing for presenting distinction information to indicate that processing can be executed when it is determined that the processing execution condition is satisfied, wherein the processing execution condition is a condition for executing processing for picking up or joining an object, and wherein controlling display-information comprises determining whether relative positions or relative attitudes of a plurality of three-dimensional objects displayed on the image display unit satisfy a predetermined condition for executing the processing for pickup or joining, and executing the processing for presenting distinction information to indicate that the processing for pickup or joining can be executed when it is determined that the condition for executing the processing for pickup or joining is satisfied;

wherein controlling display-information comprises dynamically changing the processing execution condition based on precision or resolution of measurement of three-dimensional information in the three-dimensional-information measuring step.

12. The three-dimensional-model processing method according to claim 11, wherein the processing execution condition is a condition that is set based on a three-dimensional distance, in a virtual space, between the plurality of three-dimensional objects displayed on the image display unit.

13. The three-dimensional-model processing method according to claim 11, wherein the processing execution condition is a condition that is set based on relative tilts defining attitudes of the plurality of three-dimensional objects displayed on the image display unit.

14. The three-dimensional-model processing method according to claim 11, wherein controlling display-information comprises, as the processing for presenting distinction information, executing processing for changing display mode so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

15. The three-dimensional-model processing method according to claim 14, wherein the processing for changing display mode changes at least one attribute among color, size, shape, and motion, of at least one element among surface, line, and vertex of the three-dimensional objects.

16. The three-dimensional-model processing method according to claim 11, wherein controlling display-information comprises, as the processing for presenting distinction information, a step of executing processing for outputting sound so that a three-dimensional object satisfying the processing execution condition or a three-dimensional object integrated with a three-dimensional object satisfying the processing execution condition can be distinguished from other objects.

17. The three-dimensional-model processing method according to claim 11, wherein controlling display-information comprises, as the processing for presenting distinction information to indicate that the processing for joining objects can be executed, a step of executing processing for displaying a virtual joining region showing a state after joining.

18. The three-dimensional-model processing method according to claim 11, wherein the controlling display-information comprises generating a new object and displaying the new object on the image display unit based on input information indicating that one of the operating devices is located in proximity to a position of a real object, the position being set in the three-dimensional-information measuring unit.

19. The three-dimensional-model processing method according to claim 11, wherein, based on input information indicating that one of the operating devices is located in proximity to a position of a real object for network connection, the position being set in the three-dimensional-information measuring unit, processing for communication is executed to send information of an object displayed on the image display unit, the object being associated with the one operating device, to an external apparatus connected via a network, and to display the object in a three-dimensional image provided by the external apparatus.

20. The three-dimensional-model processing method according to claim 19, wherein processing for communication is executed to send a program or program-specifying information defining operation of the object associated with the one operating device together with the object information to the external apparatus connected via the network, the operation being set in accordance with composition information of the object, and to display the object in the three-dimensional image provided by the external apparatus so that the object operates in accordance with the composition information of the object.