Virtual desktop coordinate transformation

• US 8,487,871 B2
• Filed: 06/01/2009
• Issued: 07/16/2013
• Est. Priority Date: 06/01/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Langridge, Adam Jethro, Addis, David
• Primary Examiner(s): Liang, Regina
• Application Number:
  US12/475,882
• Publication Number:
  US 20100302145A1
• Time in Patent Office: 1,506 Days
• Field of Search: 345156-158, 345/419, 463/20, 463/31, 463/39, 715848-850
• US Class Current: 345/157
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/6615 using models with different levels of detail [LOD]
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computing system includes a depth image analysis module to track a world-space pose of a human in a fixed, world-space coordinate system. The computing system further includes an interaction module to establish a virtual interaction zone with a moveable, interface-space coordinate system that tracks the human and moves relative to the fixed, world-space coordinate system. The computing system also includes a transformation module to transform a position defined in the fixed, world-space coordinate system to a position defined in the moveable, interface-space coordinate system.

Claims

1. A computing system, comprising:

a logic subsystem; and

a data-holding subsystem configured to hold instructions executed by the logic subsystem to instantiate;

a depth image analysis module to track a world-space pose of a human in a fixed, world-space coordinate system;

an interaction module to establish a virtual interaction zone with a moveable, interface-space coordinate system that tracks the human and moves relative to the fixed, world-space coordinate system; and

a transformation module to transform a position defined in the fixed, world-space coordinate system to a position defined in the moveable, interface-space coordinate system.

2. The computing system of claim 1, further comprising a display module to output a display signal for displaying an interface element at a desktop-space coordinate corresponding to the position defined in the moveable, interface-space coordinate system.

3. The computing system of claim 1, where the transformation module transforms the position defined in the fixed, world-space coordinate system to the position defined in the moveable, interface-space coordinate system by applying a transformation matrix to the position defined in the fixed, world-space coordinate system.

4. The computing system of claim 1, where the transformation module transforms the position defined in the fixed, world-space coordinate system to the position defined in the moveable, interface-space coordinate system by modeling the position in a model-space coordinate system corresponding to the fixed, world-space coordinate system and applying a transformation matrix to the position defined in the model-space coordinate system.

5. The computing system of claim 1, where the interface-space coordinate system is based on a desktop-space coordinate system of a virtual desktop.

6. The computing system of claim 1, where the virtual interaction zone is spatially defined by a cuboid.

7. The computing system of claim 6, where the moveable, interface-space coordinate system is a Cartesian coordinate system.

8. The computing system of claim 1, where the virtual interaction zone is at least partially defined by a segment of a spherical shell.

9. The computing system of claim 8, where the moveable, interface-space coordinate system is a polar coordinate system.

10. A method of providing a virtual desktop, the method comprising:

representing a human with a machine-readable model in a fixed, model-space coordinate system;

establishing an interaction zone with a moveable, interface-space coordinate system that tracks the machine-readable model and moves relative to the fixed, model-space coordinate system; and

identifying a position of a portion of the machine-readable model within the interaction zone.

11. The method of claim 10, further comprising translating the position of the portion of the machine-readable model within the interaction zone from the model-space coordinate system to the interface-space coordinate system.

12. The method of claim 11, where translating the position of the portion of the machine-readable model from the model-space coordinate system to the interface-space coordinate system includes applying a transformation matrix to model-space coordinates of the position.

13. The method of claim 10, where the interface-space coordinate system is based on a desktop-space coordinate system of the virtual desktop.

14. The method of claim 10, further comprising displaying an interface element at a desktop-space coordinate corresponding to an equivalent interface-space position of the portion of the machine-readable model within the interaction zone.

15. The method of claim 10, where the interaction zone is spatially defined by a cuboid.

16. The method of claim 15, where the interface-space coordinate system is a Cartesian coordinate system.

17. The method of claim 10, where the interaction zone is at least partially defined by a segment of a spherical shell.

18. The method of claim 17, where the interface-space coordinate system is a polar coordinate system.

19. A method of providing a virtual desktop, the method comprising:

receiving observed depth images of a human from a source;

deriving from the observed depth images a machine-readable model of the human, the machine-readable model representing the human as the human moves in world-space;

locating a reference point of the machine-readable model;

linking an interaction zone to the reference point of the machine-readable model such that the interaction zone moves with the reference point of the machine-readable model as the human moves in world-space;

locating a selector point of the machine-readable model within the interaction zone;

translating a position of the selector point within the interaction zone to an equivalent position within the virtual desktop; and

outputting a display signal for displaying an interface element at the equivalent position within the virtual desktop.

20. The method of claim 19, where the interaction zone is at least partially defined by a segment of a spherical shell.