Surface Computer User Interaction
First Claim
1. A method of controlling a surface computing device, comprising:
- capturing an image of a hand of a user interacting with a user interface displayed on a surface layer of the surface computing device;
using the image to render a corresponding representation of the hand; and
displaying the representation in the user interface on the surface layer, such that the representation is geometrically aligned with the hand.
2 Assignments
0 Petitions
Accused Products
Abstract
Surface computer user interaction is described. In an embodiment, an image of a user'"'"'s hand interacting with a user interface displayed on a surface layer of a surface computing device is captured. The image is used to render a corresponding representation of the hand. The representation is displayed in the user interface such that the representation is geometrically aligned with the user'"'"'s hand. In embodiments, the representation is a representation of a shadow or a reflection. The process is performed in real-time, such that movement of the hand causes the representation to correspondingly move. In some embodiments, a separation distance between the hand and the surface is determined and used to control the display of an object rendered in a 3D environment on the surface layer. In some embodiments, at least one parameter relating to the appearance of the object is modified in dependence on the separation distance.
-
Citations
20 Claims
-
1. A method of controlling a surface computing device, comprising:
-
capturing an image of a hand of a user interacting with a user interface displayed on a surface layer of the surface computing device; using the image to render a corresponding representation of the hand; and displaying the representation in the user interface on the surface layer, such that the representation is geometrically aligned with the hand. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A surface computing device, comprising:
-
a processor; a surface layer; a display device arranged to display a user interface on the surface layer; an image capture device arranged to capture an image of a hand of a user interacting with the surface layer; and a memory arranged to store executable instructions to cause the processor to render a corresponding representation of the hand from the image and add the representation to the user interface, such that, when displayed by the display device the representation is geometrically aligned with the hand. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
-
20. A method of controlling a surface computing device, comprising:
-
displaying a representation of a 3D environment in a user interface on a surface layer of the surface computing device; detecting selection by a user of an object rendered in the 3D environment; capturing an image of a hand of the user; determining a separation distance between the hand and the surface layer, and a planar location of the hand relative to the surface layer; using the image to render a corresponding representation of the hand; displaying the corresponding representation in the 3D environment, such that the corresponding representation is geometrically aligned with the planar location of the hand; and controlling the display of the object such that the object'"'"'s position in the 3D environment is related to the separation distance and planar location of the hand.
-
Specification