PHYSICS SIMULATION-BASED INTERACTION FOR SURFACE COMPUTING

• US 20090315839A1
• Filed: 09/03/2008
• Published: 12/24/2009
• Est. Priority Date: 06/24/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Kirk, David, Wilson, Andrew David, Izadi, Shahram, Hilliges, Otmar, Garcia-Mendoza, Armando
• Granted Patent: US 8,154,524 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: A63F 13/214 for locating contacts on a surface, e.g. floor mats or touch pads
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: G06F 2111/10 Numerical modelling
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 30/20 Design optimisation, verification or simulation optimisation, verification or simulation of circuit designs G06F30/30
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

The claimed subject matter provides a system and/or a method that facilitates enhancing interactive surface technologies for data manipulation. A surface detection component can employ a multiple contact surfacing technology to detect a surface input, wherein the detected surface input enables a physical interaction with a portion of displayed data that represents a corporeal object. A physics engine can integrate a portion of Newtonian physics into the interaction with the portion of displayed data in order to model at least one quantity related associated with the corporeal object, the quantity is at least one of a force, a mass, a velocity, or a friction.

Claims

1. A system that facilitates enhancing interactive surface technologies for data manipulation, comprising:

a surface detection component that employs a multiple contact surfacing technology to detect a surface input, the detected surface input enables a physical interaction with a portion of displayed data on a surface; and

a physics engine that integrates a portion of Newtonian physics into the interaction with the portion of displayed data in order to model at least one quantity related associated with to the portion of displayed data, the quantity is at least one of a force, a mass, a velocity, or a friction.

2. The system of claim 1, further comprising a display that renders the portion of displayed data.

3. The system of claim 2, the display is at least one of a monitor, a television, a liquid crystal display (LCD), a plasma, a rear-projection display, a front-projection display, a cathode ray tube (CRT) monitor, a flat-panel, a display for a computing device, a portable digital assistance (PDA) screen, a laptop display, a computer monitor, a smartphone display, a cellular device screen, a mobile communication device display, or a portable gaming device display.

4. The system of claim 1, further comprising a proxy object component that generates a proxy object for the detected surface input, the surface input is incorporated into a physics simulation.

5. The system of claim 4, further comprising a particle proxy component that models a contour shape of the surface input with a plurality of proxy objects, the contour of the plurality of proxy objects is a particle proxy.

6. The system of claim 5, the physics engine employs a physic update related to the portion of Newtonian physics to the particle proxy between a first simulation frame and a second simulation frame.

7. The system of claim 6, the physics engine enacts at least one of a collision force or a friction force with the physic update.

8. The system of claim 6, the physics engine enacts at least one of a gathering of two or more objects or a piling of two or more objects with the physic update.

9. The system of claim 6, the physics engine enables support for at least one of a soft body simulation, a cloth body simulation, or a fluid simulation.

10. The system of claim 1, the physics engine applies an amount of a friction force proportional to a number of proxies applied to an object which is related to a surface area of touch.

11. The system of claim 1, further comprising a flow component that calculates a motion of a particle proxy by tracking motion between a first frame and a second frame, the motion of the particle proxy is independent of tracked contact information.

12. The system of claim 11, the flow component calculates a velocity utilizing a block matching related to optical flow.

13. The system of claim 12, flow component computes a surface motion for a point related to the particle proxy is computed by comparing each successive edge image.

14. The system of claim 12, the flow component computes a tangential motion by ray casting an image point and projecting an image point onto the tangent plane formed by a 3D point and an object normal.

15. The system of claim 1, further comprising a manipulator that provides at least one of a manipulation fidelity, a gathering, a manipulation of a 3-dimensional (3D) object, or a rigidity simulation

16. A computer-implemented method that facilitates simulating physics in connection with surface computing, comprising:

detecting a surface input;

generating a proxy object for the surface input;

identifying a contour of the surface input;

dynamically modeling the contour of the proxy object with two or more proxy particle objects; and

employing at least one of a force, a velocity, or a friction for each proxy particle object between a first frame and a second frame of surface input detection.

17. The method of claim 16, further comprising providing at least one of a soft body simulation, a cloth body simulation, or a fluid simulation.

18. The method of claim 16, further comprising:

applying an amount of a friction force proportional to a number of proxies applied to an object which is related to a surface area of touch; and

sensing surface-like pressure which is transduced to force on the number of proxies.

19. The method of claim 16, further comprising calculating a motion of a particle proxy by tracking motion between a first frame and a second frame, the motion of the particle proxy is independent of tracked contact information.

20. A computer-implemented system that facilitates enhancing interactive surface technologies for data manipulation, comprising:

means for implementing a multiple contact surfacing technology to detect a surface input, the detected surface input enables a physical interaction with a portion of displayed data on a surface;

means for integrating a portion of Newtonian physics into the interaction with the portion of displayed data in order to model at least one quantity related associated with to the portion of displayed data, the quantity is at least one of a force, a mass, a velocity, or a friction;

means for generating a proxy object for the detected surface input, the surface input is incorporated into a physics simulation;

means for modeling a contour shape of the surface input with a plurality of proxy objects, the contour of the plurality of proxy objects is a particle proxy; and

means for employing a physic update related to the portion of Newtonian physics to the particle proxy between a first simulation frame and a second simulation frame.