Working with 3D objects

• US 8,514,221 B2
• Filed: 07/09/2012
• Issued: 08/20/2013
• Est. Priority Date: 01/05/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: King, Nicholas V., Benjamin, Todd
• Primary Examiner(s): Nguyen, Phu K
• Application Number:
  US13/544,624
• Publication Number:
  US 20120268410A1
• Time in Patent Office: 407 Days
• Field of Search: 345/419, 345/157, 345/158, 345/173, 345/175, 345/650, 345/653, 382/203, 341/20
• US Class Current: 345/419
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

Three-dimensional objects can be generated based on two-dimensional objects. A first user input identifying a 2D object presented in a user interface can be detected, and a second user input including a 3D gesture input that includes a movement in proximity to a surface can be detected. A 3D object can be generated based on the 2D object according to the first and second user inputs, and the 3D object can be presented in the user interface.

Claims

1. A computer-implemented method, comprising:

displaying a representation of a three-dimensional (3D) object on a touch-sensitive display;

detecting a gesture input that comprises a movement of a finger or a pointing device in proximity to a surface of the display, the detecting comprising measuring a distance between the finger or the pointing device and the surface of the display;

modifying the representation of the 3D object according to the gesture input; and

displaying the updated representation of the 3D object on the touch-sensitive display.

2. The method of claim 1, further comprising detecting at least one of a touch input or a second gesture input that comprises touching the surface of the touch-sensitive display, and modifying the representation of the 3D object according to a combination of the first gesture input and at least one of the touch input or the second gesture input.

3. The method of claim 1 in which modifying the representation of the 3D object comprises modifying at least one of size, shape, orientation, or position of the representation of the 3D object according to the movement in the gesture input.

4. The method of claim 1 in which modifying the representation of the 3D object comprises at least one of sculpting the representation of the 3D object, stretching the representation of the 3D object, compressing the representation of the 3D object, removing portions from the representation of the 3D object, adding portions to the representation of the 3D object, or taking apart portions of the representation of the 3D object according to the movement in the gesture input.

5. The method of claim 1, further comprising presenting the representation of the 3D object in a virtual 3D environment, imparting an initial speed to the representation of the 3D object according to a force represented by the gesture input, and moving the representation of the 3D object in the virtual 3D environment according to physical properties associated with the 3D object and the environment.

6. The method of claim 1, comprising detecting a touch input comprising two touch points that define an axis, and

modifying the representation of the 3D object comprises rotating the representation of the 3D object about the axis in a direction determined according to the movement in the gesture input.

7. The method of claim 1, comprising detecting a touch input that defines a reference point, and

modifying the representation of the 3D object comprises modifying the representation of the 3D object according to the movement in the gesture input relative to the reference point.

8. The method of claim 1 in which detecting the gesture input comprises detecting positions of a portion of at least one of a finger or a pointing device in three dimensions relative to the surface of the display over a period of time.

9. A computer-implemented method, comprising:

detecting, on a touch-sensitive surface, a first user input that comprises at least one of a touch input or a first gesture input;

detecting a second gesture input that comprises a movement in proximity to the touch-sensitive surface, in which a portion of the movement is performed at a distance from the touch-sensitive surface; and

generating a representation of a three-dimensional (3D) object in a user interface based on the second gesture input and at least one of the touch input or first gesture input, the representation of the 3D object having a property that depends at least in part on the portion of the movement performed at a distance from the surface.

10. The method of claim 9 in which generating the representation of the 3D object comprises defining a shape of the representation of the 3D object according to the movement in the gesture input.

11. The method of claim 10 in which defining the shape of the representation of the 3D object comprises defining the shape of a mesh object having mesh lines defined according to movements in the gesture input.

12. The method of claim 10 in which generating the representation of the 3D object comprises drawing 3D lines or patterns in a 3D environment.

13. The method of claim 9 in which detecting the gesture input comprises detecting positions of a portion of at least one of a finger or a pointing device in three dimensions relative to the surface.

14. The method of claim 9 in which the representation of the 3D object represents a virtual tool that can be used to change properties of other objects presented in the user interface, and the method further comprises detecting a second gesture input and controlling the virtual 3D tool according to the second gesture input.

15. The method of claim 9 in which the property of the representation of the 3D object comprises a height or thickness of the 3D object.

16. A method comprising:

detecting a gesture input that comprises a movement starting from a touch-sensitive surface and ending at a distance in proximity to the touch-sensitive surface, in which a portion of the movement is performed at a distance from the touch-sensitive surface; and

modifying a value of a parameter based on the gesture input, the value of the parameter depending at least in part on the portion of the movement performed at a distance from the touch-sensitive surface.

17. The method of claim 16 in which modifying a parameter based on the gesture input comprises modifying a parameter of a representation of an object shown on a display.

18. The method of claim 17 in which modifying a parameter of a representation of an object comprises modifying at least one of a dimension, color, or texture of the representation of the object.

19. The method of claim 16, comprising identifying the end of the gesture input by detecting a pause in the movement for a predetermined period of time.

20. The method of claim 16, comprising identifying the end of the gesture input by detecting a pause in the movement for a predetermined period of time, followed by a second movement indicating the end of the gesture.

21. The method of claim 16, comprising identifying the end of the first gesture input by detecting a second gesture input that indicates the end of the first gesture input.

22. A method comprising:

detecting a plurality of gesture inputs, each gesture input comprising a movement starting from a touch-sensitive surface and ending at a distance in proximity to the touch-sensitive surface; and

assigning weights to parameters based on the plurality of gesture inputs, the weights depending at least in part on relative values of the distances at which the gesture input movements end.

23. The method of claim 22 in which assigning weights to parameters comprises assigning weights to different colors or different textures.

24. The method of claim 22 in which detecting a plurality of gesture inputs comprises detecting positions of portions of a plurality of fingers in three dimensions relative to the touch-sensitive surface over a period of time.

25. An apparatus comprising:

a sensor module to detect gesture inputs each comprising a movement having a component in a direction perpendicular to a surface; and

a data processor to receive signals output from the sensor module, the signals representing detected gesture inputs, and generate or modify a representation of a three-dimensional (3D) object in a user interface according to the detected gesture inputs, in which the representation of the 3D object has a property that depends at least in part on the gesture input movement in the direction perpendicular to the surface.

26. The apparatus of claim 25, further comprising a display to show the representation of the 3D object, and

wherein the sensor module comprises a proximity sensor to detect movements in proximity to the surface of the display.

27. The apparatus of claim 25, further comprising a storage device to store information about a mapping between the movement in proximity to the surface and predefined gestures.

28. The apparatus of claim 27 in which the sensor module comprises a touch sensor and a proximity sensor, the touch sensor detecting touch inputs and gesture inputs having movements along the surface, the proximity sensor in combination with the touch sensor detecting gesture inputs having the perpendicular movement components.

29. The apparatus of claim 27 in which the sensor module comprises a capacitive based touch sensor that can detect touch inputs, gesture inputs having movements along the surface, and gesture inputs having the perpendicular movement components.

30. The apparatus of claim 25 in which the property of the representation of the 3D object comprises a height or thickness of the representation of the 3D object.

31. An apparatus comprising:

a computer storage medium storing instructions that, when executed by data processing apparatus, cause the data processing apparatus to perform operations comprising;

displaying a representation of a three-dimensional (3D) object on a touch-sensitive display;

detecting a gesture input that comprises a movement of a finger or a pointing device in proximity to a surface of the display, the detecting comprising measuring a distance between the finger or the pointing device and the surface of the display;

modifying the representation of the 3D object according to the gesture input; and

displaying the updated representation of the 3D object on the touch-sensitive display.