Working with 3D objects

• US 8,232,990 B2
• Filed: 01/05/2010
• Issued: 07/31/2012
• Est. Priority Date: 01/05/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: King, Nicholas V., Benjamin, Todd
• Primary Examiner(s): Nguyen, Phu K
• Application Number:
  US12/652,721
• Publication Number:
  US 20110164029A1
• Time in Patent Office: 938 Days
• Field of Search: 345/419, 345/157, 345/158, 345/173, 345/175, 345/650, 345/653, 382/203, 341/20
• US Class Current: 345/419
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

Three-dimensional objects can be generated based on two-dimensional objects. A first user input identifying a 2D object presented in a user interface can be detected, and a second user input including a 3D gesture input that includes a movement in proximity to a surface can be detected. A 3D object can be generated based on the 2D object according to the first and second user inputs, and the 3D object can be presented in the user interface.

Claims

1. A computer-implemented method, comprising:

detecting a first user input identifying a two-dimensional (2D) object presented on a surface of a display device;

detecting a second user input including a three-dimensional (3D) gesture input comprising a movement in proximity to the surface, in which a portion of the movement is performed at a distance from the surface;

generating, at a computing device, a 3D object based on the 2D object according to the first and second user inputs, the 3D object having a property that depends at least in part on the portion of the movement performed at a distance from the surface; and

presenting the 3D object on the surface.

2. The method of claim 1 in which generating the 3D object comprises extruding the 2D object to form the 3D object.

3. The method of claim 2 in which detecting the second user input comprises detecting a movement of a finger or a pointing device from a first position to a second position relative to the surface, and

extruding the 3D object comprises defining a thickness of the 3D object in proportion to a difference in a first value and a second value, the first value representing a distance between the first position and the surface, the second value representing a distance between the second position and the surface.

4. The method of claim 1 in which the second user input also comprises a touch input representing at least one finger or input device, or at least one pointer associated with the at least one finger or pointing device, positioned at or in a vicinity of a portion of the 2D object, and the 3D gesture input comprises moving the at least one finger or pointing device away from the surface.

5. The method of claim 1 in which detecting the first user input comprises detecting at least two touch points associated with portions of the at least one finger or pointing device, and

detecting the second user input comprises detecting the portions moving away from the surface at substantially the same time.

6. The method of claim 1 in which the property of the 3D object comprises a height or thickness of the 3D object.

7. A computer-implemented method comprising:

identifying a three-dimensional (3D) object shown on a surface of a touch-sensitive display;

detecting a 3D gesture input that comprises a movement of a finger or a pointing device in proximity to the surface, the detecting comprising measuring a distance between the finger or the pointing device and the surface of the display;

modifying the 3D object according to the 3D gesture input; and

showing the updated 3D object on the surface.

8. The method of claim 7, further comprising detecting at least one of a touch input or a two-dimensional (2D) gesture input that comprises touching the surface of the touch-sensitive display, and modifying the 3D object according to a combination of the 3D gesture input and at least one of the touch input or 2D gesture input.

9. The method of claim 7 in which modifying the 3D object comprises modifying at least one of size, shape, orientation, or position of the 3D object according to the movement in the 3D gesture input.

10. The method of claim 7 in which modifying the 3D object comprises at least one of sculpting the object, stretching the object, compressing the object, removing portions from the object, adding portions to the object, or taking apart portions of the object according to the movement in the 3D gesture input.

11. The method of claim 7, further comprising presenting the 3D object in a virtual 3D environment, imparting an initial speed to the object according to a force represented by the 3D gesture input, and moving the object in the virtual 3D environment according to physical properties associated with the 3D object and the environment.

12. The method of claim 7 in which detecting the first user input comprises detecting a touch input comprising two touch points that define an axis, and

modifying the 3D object comprises rotating the 3D object about the axis in a direction determined according to the movement in the 3D gesture input.

13. The method of claim 7 in which detecting the first user input comprises detecting a touch input that defines a reference point, and

modifying the 3D object comprises modifying the 3D object according to the movement in the 3D gesture input relative to the reference point.

14. The method of claim 7 in which detecting the 3D gesture input comprises detecting positions of a portion of at least one of a finger or a pointing device in three dimensions relative to the surface of the display over a period of time.

15. A computer-implemented method, comprising:

detecting a first user input that comprises at least one of a touch input or a two-dimensional (2D) gesture input;

detecting a three-dimensional (3D) gesture input that comprises a movement in proximity to a surface, in which a portion of the movement is performed at a distance from the surface; and

generating, at a computing device, a 3D object in a user interface based on the 3D gesture input and at least one of the touch input or 2D gesture input, the 3D object having a property that depends at least in part on the portion of the movement performed at a distance from the surface.

16. The method of claim 15 in which generating the 3D object comprises defining a shape of the 3D object according to the movement in the 3D gesture input.

17. The method of claim 16 in which defining the shape of the 3D object comprises defining the shape of a mesh object having mesh lines defined according to movements in the gesture input.

18. The method of claim 16 in which generating the 3D object comprises drawing 3D lines or patterns in a 3D environment.

19. The method of claim 15 in which detecting the 3D gesture input comprises detecting positions of a portion of at least one of a finger or a pointing device in three dimensions relative to the surface.

20. The method of claim 15 in which the 3D object represents a virtual tool that can be used to change properties of other objects presented in the user interface, and the method further comprises detecting a second 3D gesture input and controlling the virtual 3D tool according to the second 3D gesture input.

21. The method of claim 15 in which the property of the 3D object comprises a height or thickness of the 3D object.

22. An apparatus comprising:

a sensor module to detect touch inputs, two-dimensional (2D) gesture inputs that are associated with a surface, and three-dimensional (3D) gesture inputs, each 3D gesture input comprising a movement having a component in a direction perpendicular to the surface; and

a data processor to receive signals output from the sensor module, the signals representing detected 3D gesture inputs and at least one of detected touch inputs or detected 2D gesture inputs, and

generate or modify a 3D object in a user interface according to the detected 3D gesture inputs and at least one of detected touch inputs or detected 2D gesture inputs, in which the 3D object has a property that depends at least in part on the 3D gesture input movement in the direction perpendicular to the surface.

23. The apparatus of claim 22, further comprising a display to show the 3D object, in which the touch sensor detects touching of a surface of the display, and the apparatus comprises a proximity sensor to detect movements in proximity to the surface of the display.

24. The apparatus of claim 22, further comprising a storage device to store information about a mapping between the movement in proximity to the surface and predefined 3D gestures.

25. The apparatus of claim 24 in which the sensor module comprises a touch sensor and a proximity sensor, the touch sensor detecting the touch inputs and the 2D gesture inputs, the proximity sensor in combination with the touch sensor detecting the 3D gesture inputs.

26. The apparatus of claim 24 in which the sensor module comprises a capacitive based touch sensor that can detect the touch inputs, 2D gesture inputs, and 3D gesture inputs.

27. The apparatus of claim 22 in which the property of the 3D object comprises a height or thickness of the 3D object.

28. An apparatus comprising:

a computer storage medium storing instructions that, when executed by data processing apparatus, cause the data processing apparatus to perform operations comprising;

detecting a first user input identifying a two-dimensional (2D) object presented in a user interface,

detecting a second user input including a three-dimensional (3D) gesture input comprising a movement in proximity to a surface, in which a portion of the movement is performed at a distance from the surface,

generating a 3D object in the user interface based on the 2D object according to the first and second user inputs, the 3D object having a property that depends at least in part on the portion of the movement performed at a distance from the surface, and

presenting the 3D object in the user interface.