MULTI-PLATFORM MOTION-BASED COMPUTER INTERACTIONS

• US 20120299827A1
• Filed: 05/27/2011
• Published: 11/29/2012
• Est. Priority Date: 05/27/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Osborn, Dan, Willoughby, Christopher, Mount, Brian, Goel, Vaibhav, Psiaki, Tim, Wright, Shawn C., Vuchetich, Christopher
• Granted Patent: US 8,957,858 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/08 Cursor circuits

Abstract

Systems and methods for multi-platform motion interactivity, is provided. The system includes a motion-sensing subsystem, a display subsystem including a display, a logic subsystem, and a data-holding subsystem containing instructions executable by the logic subsystem. The system configured to display a displayed scene on the display; receive a dynamically-changing motion input from the motion-sensing subsystem that is generated in response to movement of a tracked object; generate, in real time, a dynamically-changing 3D spatial model of the tracked object based on the motion input; control, based on the movement of the tracked object and using the 3D spatial model, motion within the displayed scene. The system further configured to receive, from a secondary computing system, a secondary input; and control the displayed scene in response to the secondary input to visually represent interaction between the motion input and the secondary input.

Claims

1. A computing system with multi-platform motion interactivity, comprising:

a motion-sensing subsystem;

a display subsystem including a display;

a logic subsystem;

a data-holding subsystem containing instructions executable by the logic subsystem to;

display a displayed scene on the display;

receive a dynamically-changing motion input from the motion-sensing subsystem that is generated in response to movement of a tracked object;

generate, in real time, a dynamically-changing 3D spatial model of the tracked object based on the motion input;

control, based on the movement of the tracked object and using the 3D spatial model, motion within the displayed scene;

receive, from a secondary computing system, a secondary input; and

control the displayed scene in response to the secondary input to visually represent interaction between the motion input and the secondary input.

2. The computing system of claim 1, where control of the displayed scene in response to the secondary input includes controlling display of a virtual element within the displayed scene in response to the secondary input, the instructions being further executable to permit;

virtual interaction with the virtual element via the movement of the tracked object; and

corresponding changes of the 3D spatial model.

3. The computing system of claim 1 where the instructions are further configured to transmit, to the secondary computing system, a motion output based on the 3D spatial model, the motion output being configured to permit the secondary computing system to visually represent movement of the tracked object.

4. The computing system of claim 3, where control of the displayed scene in response to the secondary input includes controlling display of a virtual element within the displayed scene in response to the secondary input, the instructions being further executable to permit virtual interaction with the virtual element via the movement of the tracked object and corresponding changes of the 3D spatial model.

5. The computing system of claim 3, where the motion output is transmitted wirelessly to the secondary computing system.

6. The computing system of claim 3, where visually representing movement of the tracked object at the secondary computing system includes displaying, on a display of the secondary computing system, an object location within a displayed scene which is changeable in response to movement of the tracked object.

7. The computing system of claim 1, where the secondary computing system is remotely located.

8. The computing system of claim 1, where the secondary input is generated in response to user interaction with an interactive display of the secondary computing system.

9. The computing system of claim 1, where the secondary input is generated in response to motion sensing at the secondary computing system.

10. A method of providing multi-platform motion interactivity, comprising

displaying a displayed scene on a display of a first computing system;

receiving a dynamically-changing motion input from a motion-sensing system that is generated in response to movement of a tracked object;

generating, in real time, a dynamically-changing 3D spatial model of the tracked object based on the motion input;

controlling, based on the movement of the tracked object and using the 3D spatial model, motion within the displayed scene;

receiving, from a secondary computing system, a secondary input; and

controlling the displayed scene in response to the secondary input to visually represent interaction between the motion input and the secondary input.

11. The method of claim 10, where controlling the displayed scene in response to the secondary input further includes controlling display of a virtual element within the displayed scene in response to the secondary input.

12. The method of claim 11, further including permitting virtual interaction between the virtual element and a virtual representation of the tracked object.

13. The method of claim 10, where the secondary computing system is remotely located.

17. The method of claim 10, where the secondary input is generated in response to motion sensing at the secondary computing system.

18. The method of claim 10, further comprising displaying a display of the secondary computing system that visually represents the movement of the tracked object.

19. The method of claim 10, where the secondary input is transmitted wirelessly to the first computing system.

14. The method of dais 10, where the secondary input is generated in response to user interaction with an interactive display of the secondary computing system.

15. The method of claim 14, where the user interaction is a user touch detected by the interactive display of the secondary computing system.

16. The method of claim 14, where the user interaction is a user swipe detected by the interactive display of the secondary computing system.

20. A computing system with multi-platform motion interactivity, comprising:

a real-time optical motion-sensing subsystem;

a display subsystem including a display;

a logic subsystem;

a data-holding subsystem containing instructions executable by the logic subsystem to;

display a displayed scene on the display;

receive a dynamically-changing motion input from the motion-sensing subsystem that is generated in response to movement of a tracked object;

generate, in real time, a dynamically-changing 3D spatial model of the tracked object based on the motion input;

control, based on the movement of the tracked object and using the 3D spatial model, motion within the displayed scene;

receive, from a secondary computing system, a secondary input;

transmit to the secondary computing system, a motion output based on the 3D spatial model, the motion output being configured to permit the secondary computing system to visually represent movement of the tracked object;

control the displayed scene including display of a virtual element within the displayed scene in response to the secondary input to visually represent interaction between the motion input and the secondary input; and

permit virtual interaction with the virtual element via the movement of the tracked object and corresponding changes of the 3D spatial model.