Three dimensional user interface effects on a display by using properties of motion
First Claim
1. A graphical user interface method, comprising:
- receiving positional data from one or more position sensors disposed within a device;
determining a 3D frame of reference for the device based at least in part on the received positional data;
displaying a plurality of graphical user interface objects depicted in a sub-box form factor on a display of the device at a first orientation with respect to the 3D frame of reference;
receiving optical data from one or more optical sensors disposed within the device;
determining a position of a user'"'"'s eyes based on the optical data;
determining a position of an ambient light source based on the optical data;
determining a position of a graphical layer with respect to at least one graphical user interface object based at least in part on the determined 3D frame of reference and the position of the ambient light source, the graphical layer creating a lighting effect with respect to the at least one graphical user interface object;
generating a virtual 3D depiction of the at least one graphical user interface object on the display of the device with the graphical layer positioned with respect to the at least one graphical user interface object based on the position of the ambient light source;
monitoring the position of the device and the position of the user'"'"'s eyes; and
adjusting the generated virtual 3D depiction of the at least one graphical user interface object on the display of the device, in response to movement of the device or the position of the user'"'"'s eyes, to depict at least one of;
a top surface of the at least one graphical user interface object, a side surface of the at least one graphical user interface object, or behind the least one graphical user interface object;
wherein the at least one graphical user interface object is represented in a virtual 3D operating system environment.
1 Assignment
0 Petitions
Accused Products
Abstract
The techniques disclosed herein use a compass, MEMS accelerometer, GPS module, and MEMS gyrometer to infer a frame of reference for a hand-held device. This can provide a true Frenet frame, i.e., X- and Y-vectors for the display, and also a Z-vector that points perpendicularly to the display. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track the Frenet frame of the device in real time to provide a continuous 3D frame-of-reference. Once this continuous frame of reference is known, the position of a user'"'"'s eyes may either be inferred or calculated directly by using a device'"'"'s front-facing camera. With the position of the user'"'"'s eyes and a continuous 3D frame-of-reference for the display, more realistic virtual 3D depictions of the objects on the device'"'"'s display may be created and interacted with by the user.
49 Citations
33 Claims
-
1. A graphical user interface method, comprising:
-
receiving positional data from one or more position sensors disposed within a device; determining a 3D frame of reference for the device based at least in part on the received positional data; displaying a plurality of graphical user interface objects depicted in a sub-box form factor on a display of the device at a first orientation with respect to the 3D frame of reference; receiving optical data from one or more optical sensors disposed within the device; determining a position of a user'"'"'s eyes based on the optical data; determining a position of an ambient light source based on the optical data; determining a position of a graphical layer with respect to at least one graphical user interface object based at least in part on the determined 3D frame of reference and the position of the ambient light source, the graphical layer creating a lighting effect with respect to the at least one graphical user interface object; generating a virtual 3D depiction of the at least one graphical user interface object on the display of the device with the graphical layer positioned with respect to the at least one graphical user interface object based on the position of the ambient light source; monitoring the position of the device and the position of the user'"'"'s eyes; and adjusting the generated virtual 3D depiction of the at least one graphical user interface object on the display of the device, in response to movement of the device or the position of the user'"'"'s eyes, to depict at least one of;
a top surface of the at least one graphical user interface object, a side surface of the at least one graphical user interface object, or behind the least one graphical user interface object;wherein the at least one graphical user interface object is represented in a virtual 3D operating system environment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A graphical user interface, comprising:
-
a viewing surface; a virtual 3D operating system environment; one or more graphical user interface objects depicted in a sub-box form factor; and a graphical layer positioned with respect to the one or more graphical user interface objects, the graphical layer creating a lighting effect with respect to the at least one graphical user interface object based on a position of an ambient light source relative to the viewing surface; wherein the one or more graphical user interface objects and the graphical layer are represented in the virtual 3D operating system environment and depicted on the viewing surface, wherein the depiction of the one or more graphical user interface objects on the viewing surface and the graphical layer positioned with respect to the one or more graphical user interface objects is determined and updated at least in part by a determined 3D frame of reference of the viewing surface with respect to a position of a user of the viewing surface, and wherein a spotlight effect is applied to an individual sub-box in the virtual 3D operating system environment based on a position of the user'"'"'s eyes with respect to the position of the viewing surface. - View Dependent Claims (20, 21, 22, 23, 24)
-
-
25. An apparatus, comprising:
-
a display; one or more optical sensors; one or more positional sensors; a memory; and one or more programmable control devices communicatively coupled to the display, the one or more optical sensors, the one or more positional sensors, and the memory, wherein the memory includes instructions for causing the one or more programmable control devices to; receive positional data from the one or more positional sensors; determine a 3D frame of reference for the apparatus based at least in part on the received positional data; display a plurality of graphical user interface objects depicted in a sub-box form factor on the display at a first orientation with respect to the 3D frame of reference; receive optical data from the one or more optical sensors; determine a position of a user'"'"'s eyes based on the optical data; determine a position of an ambient light source based on the optical data; determine a position of a graphical layer with respect to the at least one graphical user interface object based at least in part on the determined 3D frame of reference and the position of the ambient light source, the graphical layer creating a lighting effect with respect to the at least one graphical user interface object; render a virtual 3D depiction of at least one graphical user interface object and the graphical layer positioned with respect to the at least one graphical user interface object on the display based on the position of the ambient light source; monitor the position of the apparatus and the position of the user'"'"'s eyes; and reposition the graphical layer with respect to the at least one graphical user interface object in response to a change in the 3D frame of reference based on the positional data or the position of the user'"'"'s eyes to depict at least one of;
a top surface of the at least one graphical user interface object, a side surface of the at least one graphical user interface object, or behind the least one graphical user interface object;wherein the at least one graphical user interface object is represented in a virtual 3D operating system environment. - View Dependent Claims (26, 27, 28, 29, 30, 31, 32, 33)
-
Specification