Method and apparatus for generating a three-dimensional user interface

• US 9,684,412 B2
• Filed: 05/30/2013
• Issued: 06/20/2017
• Est. Priority Date: 04/26/2013
• Status: Active Grant

• Current Assignee: Spreadtrum Communications USA
• Original Assignee: Spreadtrum Communications USA
• Inventors: Xia, Lu, Liu, Haipeng
• Primary Examiner(s): PHAM, VIET DAVID
• Application Number:
  US14/118,061
• Publication Number:
  US 20160041641A1
• Time in Patent Office: 1,482 Days
• Field of Search: 345173
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 15/005 General purpose rendering architectures

Abstract

A method for providing a three-dimensional user interface includes generating an image of a three-dimensional scene according to a set of camera parameters. The three-dimensional scene includes a plurality of three-dimensional graphical elements. The three-dimensional graphical elements are associated with a plurality of applications stored on a computing device. The method further includes receiving a user input; adjusting the camera parameters according to the user input; and updating the image of the three-dimensional scene according to the adjusted camera parameters.

Claims

1. A method for providing a three-dimensional user interface, including:

generating an image of a three-dimensional scene according to a set of camera parameters, the three-dimensional scene including a plurality of three-dimensional graphical elements, the three-dimensional graphical elements being associated with a plurality of applications stored on a computing device, wherein the computing device includes a touch screen, and the camera parameters include a location and an orientation of a camera center;

receiving a user input, wherein the user input indicates a point of contact between a user and the touch screen;

determining a motion of the point of contact from a first location on the touch screen to a second location on the touch screen;

determining a first set of screen coordinates for the first location on the touch screen and a second set of screen coordinates for the second location on the touch screen, the first set of screen coordinates and the second set of screen coordinates each being defined with respect to a screen coordinate system associated with the touch screen;

determining one or more changes between the first set of screen coordinates and the second set of screen coordinates;

applying a rotation operation to the orientation of the camera center based on a direction of the motion of the point of contact, wherein the rotation operation applied to the orientation of the camera has a nonlinear relationship with the one or more changes between the first set of screen coordinates and the second set of screen coordinates;

adjusting the location of the camera center based on the first set of screen coordinates and the second set of screen coordinates, wherein the adjustment to the location of the camera is proportional to the one or more changes between the first set of screen coordinates and the second set of screen coordinates and is determined based on a preset ratio between a dimension of the three-dimensional scene and a resolution of the touch screen; and

updating the image of the three-dimensional scene according to the rotated orientation of the camera center and the adjusted location of the camera center.

2. The method of claim 1, further comprising associating a theme to the three-dimensional scene.

3. The method of claim 1, wherein the method further comprises displaying the image of the three-dimensional scene on the touch screen.

4. The method of claim 1, further comprising determining the rotation based on a multiplication of a factor and the motion of the point of contact.

5. The method of claim 4, further comprising determining the factor based on a screen resolution of the touch screen and a maximum allowable rotation for the camera center, the maximum allowable rotation corresponding to a maximum range of the user input.

6. The method of claim 1, further comprising:

generating images of the graphical elements according to the adjusted location and the rotated orientation of the camera center;

receiving another user input, wherein the another user input indicates another point of contact between the user and the touch screen;

selecting one of the graphical elements in response to the another user input; and

displaying the image of the selected graphical element at a center of the touch screen.

7. The method of claim 6, wherein the selecting of one of the graphical elements further comprises:

determining screen coordinates for the images of the graphical elements; and

selecting one of the graphical elements by comparing the screen coordinates of the images of the graphical elements and the screen coordinates of the another point of contact.

8. The method of claim 7, wherein the selecting of one of the graphical elements further comprises selecting the graphical element having an image closer to the another point of contact than the images of the other graphical elements.

9. The method of claim 7, further comprising selecting one of the graphical elements according to a priority list when two or more images of the graphical elements are at equal distances from the another point of contact.

10. An apparatus for providing a three-dimensional user interface, comprising:

a touch screen including;

an input module for receiving a user input, wherein the user input indicates a point of contact between a user and the touch screen; and

an output module for displaying an image of a three-dimensional scene;

a storage module for storing computer-executable instructions and a plurality of applications; and

a processor for executing the computer-executable instructions, the computer-executable instructions causing the processor to;

generate the image of the three-dimensional scene according to a set of camera parameters, the three-dimensional scene including a plurality of three-dimensional graphical elements, the three-dimensional graphical elements being associated with the applications stored in the storage medium, wherein the camera parameters include a location and an orientation of a camera center;

determine a motion of the point of contact from a first location on the touch screen to a second location on the touch screen;

determine a first set of screen coordinates for the first location on the touch screen and a second set of screen coordinates for the second location on the touch screen, the first set of screen coordinates and the second set of screen coordinates each being defined with respect to a screen coordinate system associated with the touch screen;

determine one or more changes between the first set of screen coordinates and the second set of screen coordinates;

apply a rotation operation to the orientation of the camera center based on a direction of the motion of the point of contact, wherein the rotation operation applied to the orientation of the camera has a nonlinear relationship with the one or more changes between the first set of screen coordinates and the second set of screen coordinates;

adjust the location of the camera center based on the first set of screen coordinates and the second set of screen coordinates, wherein the adjustment to the location of the camera is proportional to the one or more changes between the first set of screen coordinates and the second set of screen coordinates and is determined based on a preset ratio between a dimension of the three-dimensional scene and a resolution of the touch screen; and

update the image of the three-dimensional scene according to the rotated orientation of the camera center and the adjusted location of the camera center.

11. The apparatus of claim 10, wherein the apparatus is a handheld device.

12. A computer-readable medium including instructions, which, when executed by a processor, cause the processor to perform a method for providing a three-dimensional user interface, the method comprising:

generating an image of a three-dimensional scene according to a set of camera parameters, the three-dimensional scene including a plurality of three-dimensional graphical elements, the three-dimensional graphical elements being associated with a plurality of applications stored on a computing device, wherein the computing device includes a touch screen, and the camera parameters include a location and an orientation of a camera center;

receiving a user input, wherein the user input indicates a point of contact between a user and the touch screen;

determining a motion of the point of contact from a first location on the touch screen to a second location on the touch screen;

determining a first set of screen coordinates for the first location on the touch screen and a second set of screen coordinates for the second location on the touch screen, the first set of screen coordinates and the second set of screen coordinates each being defined with respect to a screen coordinate system associated with the touch screen;

determining one or more changes between the first set of screen coordinates and the second set of screen coordinates;

applying a rotation operation to the orientation of the camera center based on a direction of the motion of the point of contact, wherein the rotation operation applied to the orientation of the camera has a nonlinear relationship with the one or more changes between the first set of screen coordinates and the second set of screen coordinates;

adjusting the location of the camera center based on the first set of screen coordinates and the second set of screen coordinates, wherein the adjustment to the location of the camera is proportional to the one or more changes between the first set of screen coordinates and the second set of screen coordinates and is determined based on a preset ratio between a dimension of the three-dimensional scene and a resolution of the touch screen; and

updating the image of the three-dimensional scene according to the rotated orientation of the camera center and the adjusted location of the camera center.