Virtual desktop coordinate transformation

• US 8,917,240 B2
• Filed: 06/28/2013
• Issued: 12/23/2014
• Est. Priority Date: 06/01/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Langridge, Adam Jethro, Addis, David
• Primary Examiner(s): Liang, Regina
• Application Number:
  US13/931,499
• Publication Number:
  US 20130285903A1
• Time in Patent Office: 543 Days
• Field of Search: 345156-158, 345/419, 463/20, 463/31, 463/39, 715848-850
• US Class Current: 345/157
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/6615 using models with different levels of detail [LOD]
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computing system includes a depth image analysis module to track a world-space pose of a human in a fixed, world-space coordinate system. The computing system further includes an interaction module to establish a virtual interaction zone with an interface-space coordinate system that tracks the human. The computing system also includes a transformation module to transform a position defined in the fixed, world-space coordinate system to a position defined in the interface-space coordinate system.

Claims

1. A method of providing a virtual desktop, the method comprising:

tracking a world-space pose of a human;

establishing a virtual interaction zone with an interface-space coordinate system that tracks the human and moves relative to a fixed, world-space coordinate system; and

transforming a position defined in the fixed, world-space coordinate system to a position defined in the moveable, interface-space coordinate system.

2. The method of claim 1, further comprising outputting a display signal for displaying an interface element at a desktop-space coordinate corresponding to the position defined in the moveable, interface-space coordinate system.

3. The method of claim 1, where transforming the position defined in the fixed, world-space coordinate system to the position defined in the moveable, interface-space coordinate system includes applying a transformation matrix to the position defined in the fixed, world-space coordinate system.

4. The method of claim 1, where transforming the position defined in the fixed, world-space coordinate system to the position defined in the moveable, interface-space coordinate system includes modeling the position in a model-space coordinate system corresponding to the fixed, world-space coordinate system and applying a transformation matrix to the position defined in the model-space coordinate system.

5. The method of claim 1, where the interface-space coordinate system is based on a desktop-space coordinate system of a virtual desktop.

6. The method of claim 1, where the virtual interaction zone is spatially defined by a cuboid.

7. The method of claim 6, where the moveable, interface-space coordinate system is a Cartesian coordinate system.

8. The method of claim 1, where the virtual interaction zone is at least partially defined by a segment of a spherical shell.

9. The method of claim 8, where the moveable, interface-space coordinate system is a polar coordinate system.

10. A method of providing a virtual desktop, the method comprising:

tracking a world-space pose of a human in a fixed, world-space coordinate system;

establishing a virtual interaction zone with an interface-space coordinate system;

if a virtual-desktop-controlling portion of the human is within the virtual interaction zone, calculating a position of the virtual-desktop-controlling portion within the interface-space coordinate system; and

if the virtual-desktop-controlling portion of the human is not within the virtual interaction zone, calculating a position of the virtual-desktop-controlling portion within the fixed, world-space coordinate system.

11. The method of claim 10, further comprising outputting a display signal for displaying an interface element at a desktop-space coordinate corresponding to the position of the virtual-desktop-controlling portion within the interface-space coordinate system.

12. The method of claim 10, where the interface-space coordinate system is based on a desktop-space coordinate system of the virtual desktop.

13. The method of claim 10, where the virtual interaction zone is spatially defined by a cuboid.

14. The method of claim 13, where the interface-space coordinate system is a Cartesian coordinate system.

15. The method of claim 10, where the virtual interaction zone is at least partially defined by a segment of a spherical shell.

16. The method of claim 15, where the interface-space coordinate system is a polar coordinate system.

17. A computing system, comprising:

a logic subsystem; and

a data-holding subsystem configured to hold instructions executable by the logic subsystem to instantiate;

a depth image analysis module to track a world-space pose of a human;

an interaction module to establish a virtual interaction zone with an interface-space coordinate system that tracks the human and moves relative to a fixed, world-space coordinate system;

a transformation module to transform a position of a hand of the human as defined in the fixed, world-space coordinate system to a position defined in the moveable, interface-space coordinate system; and

a display module for displaying an interface element at a desktop-space coordinate corresponding to the position defined in the moveable, interface-space coordinate system.

18. The computing system of claim 17, where the transformation module applies a transformation matrix to the position defined in the fixed, world-space coordinate system to transform the position defined in the fixed, world-space coordinate system to the position defined in the moveable, interface-space coordinate system.

19. The computing system of claim 17, where the transformation module applies a transformation matrix to a position defined in a model-space coordinate system that corresponds to the position defined in the fixed, world-space coordinate system.

20. The computing system of claim 17, where the interface-space coordinate system is based on a desktop-space coordinate system of a virtual desktop.