MOTION CONTROLLED USER INTERFACE

• US 20100100853A1
• Filed: 10/20/2008
• Published: 04/22/2010
• Est. Priority Date: 10/20/2008
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bonnet, Olivier, Ciudad, Jean-Pierre, Goyet, Romain
• Application Number:
  US12/254,785
• Publication Number:
  US 20100100853A1
• Time in Patent Office: Days
• US Class Current: 715/856
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A graphical user interface (GUI) is disclosed. The GUI comprises a three-dimensional virtual desktop surface. The GUI displays a view of the three-dimensional virtual desktop surface from a selected viewpoint and viewing angle and modifies at least one of the viewpoint and viewing angle based on detected head movements of a user.

Claims

1. A graphical user interface comprising a three-dimensional virtual desktop surface, wherein the graphical user interface displays a view of the three-dimensional virtual desktop surface from a selected viewpoint and viewing angle, and

wherein the graphical user interface modifies at least one of the viewpoint and viewing angle based on detected head movements of a user in use.

2. The graphical user interface according to claim 1, further comprising a pointer, wherein the position of the pointer is controlled by a pointing device.

3. The graphical user interface according to claim 2, wherein the view is a projection of the virtual desktop surface onto a screen, the pointer is displayed on the screen and movements of the pointing device are mapped to movements of the pointer across the screen.

4. The graphical user interface according to claim 1, wherein the virtual desktop surface has a concave shape.

5. The graphical user interface according to claim 1, wherein the virtual desktop surface has a convex shape.

6. The graphical user interface according to claim 1, wherein the virtual desktop surface is in the shape of a half-cylinder.

7. The graphical user interface according to claim 1, wherein detectable positions of the user'"'"'s head are mapped to virtual positions of the viewpoint.

8. The graphical user interface according to claim 1, wherein detectable positions of the user'"'"'s head are mapped to virtual velocities of the viewpoint.

9. The graphical user interface according to claim 1, wherein detectable positions of the user'"'"'s head are mapped to viewing angles.

10. The graphical user interface according to claim 1, wherein detectable positions of the user'"'"'s head are mapped to virtual angular velocities of the viewing angle.

11. The graphical user interface according to claim 1, wherein the graphical user interface modifies the viewpoint and viewing angle in response to detected head movements in the same way that the viewpoint and viewing angle would change if the virtual desktop surface were a physical object.

12. A graphical user interface comprising a virtual desktop surface, wherein the graphical user interface displays a view of the virtual desktop surface and at least one virtual item arranged on the virtual desktop surface,

wherein the virtual items on a magnified part of the virtual desktop surface are displayed in magnified form compared to virtual items on other parts of the virtual desktop surface;

and

wherein the graphical user interface modifies which part of the virtual desktop surface is the magnified part based on detected head movements of a user in use.

13. An information processing apparatus comprising:

a processing unit;

a display device; and

an image capture device for capturing an image of a user and supplying the image to the processing unit;

wherein the processing unit drives the display device to display a graphical user interface comprising a view of a three-dimensional virtual desktop surface, the view being from a selected virtual viewpoint and viewing angle; and

wherein the processing unit calculates a position of the user'"'"'s head relative to the image capture device based on the image and selects at least one of the viewpoint and viewing angle based on the calculated position of the user'"'"'s head.

14. The information processing apparatus according to claim 13, wherein the processing unit includes a face recognition unit for identifying the positions of the user'"'"'s eyes in the image, and

wherein the processing unit calculates the position of the user'"'"'s head based on the positions of the user'"'"'s eyes in the image.

15. The information processing apparatus according to claim 14, wherein the processing unit calculates the distance of the user'"'"'s head from the image capture device based on a separation distance between the user'"'"'s eyes in the image.

16. The information processing apparatus according to claim 13, further comprising a pointing device controlling a virtual pointer overlaid on the view of the virtual desktop surface in the graphical user interface.

17. The information processing apparatus according to claim 13, wherein the processing unit selects the viewpoint and viewing angle based on the displacement of the user'"'"'s head from an initial position calculated by the processing unit.

18. An information processing apparatus comprising:

a display device having a screen for displaying an image;

a head position detection unit for calculating a position of a user'"'"'s head relative to the screen; and

a graphical user interface generation unit for generating a graphical user interface for display on the screen, the graphical user interface comprising a projection of a three-dimensional virtual desktop surface in a virtual space onto the screen;

wherein the graphical user interface generation unit controls at least one of a virtual position and a virtual orientation of the screen relative to the virtual desktop surface in the virtual space in dependence on the position of the user'"'"'s head calculated by the head position detection unit.

19. The information processing apparatus according to claim 18, wherein the head position detection unit comprises:

an image capture device for capturing an image of the user; and

a face recognition unit for identifying a position of the user'"'"'s face in the image.

20. An information processing apparatus comprising:

a display device;

a head position detection unit for detecting a position of a user'"'"'s head;

a pointing device for outputting a signal indicating physical motion of the pointing device; and

a graphical user interface generation unit for generating a graphical user interface, the graphical user interface comprising a virtual desktop surface and a pointer overlaid on the virtual desktop surface;

wherein the graphical user interface generation unit controls a view of the virtual desktop surface displayed on the display device in dependence on the position of the user'"'"'s head calculated by the head position detection unit; and

wherein the graphical user interface generation unit controls a position of the pointer on the virtual desktop surface in dependence on the signal output by the pointing device.

21. The information processing apparatus according to claim 20, wherein the head position detection unit comprises:

an image capture device for capturing an image of the user; and

a face recognition unit for identifying a position of the user'"'"'s face in the image.

22. The information processing apparatus according to claim 20, wherein the virtual desktop surface is a three-dimensional surface and the view is defined by a viewpoint and a viewing angle.

23. The information processing apparatus according to claim 20, wherein the virtual desktop surface has a magnified part, items arranged on the magnified part being displayed in a magnified form compared to items arranged on other parts of the virtual desktop surface, and

wherein the view is defined by the location of the magnified part on the virtual desktop surface.

24. A method of displaying a plurality of icons on a screen comprising:

arranging the icons on a three-dimensional virtual desktop surface defined in a virtual space;

displaying on the screen a projection of the virtual desktop surface onto a virtual screen defined in the virtual space;

detecting a position of a user s head relative to the screen; and

modifying a position of the virtual screen relative to the virtual desktop surface in the virtual space based on the detected position of the user'"'"'s head.