Coordinating Haptics with Visual Images in a Human-Computer Interface
First Claim
1. A method of generating a three-dimensional haptic component of a human-computer interface corresponding to a two-dimensional image of an object, comprising:
- a) Selecting from a library of haptic models an initial haptic model that is topologically similar to the object;
b) Establishing correspondence between a set of correspondence points in the three-dimensional initial haptic model and a set of correspondence points in the two-dimensional image of the object;
c) Generating a final haptic model by modifying the initial haptic model so that the two-dimensional projection of the correspondence points in the final haptic model are substantially aligned with the correspondence points in the two-dimensional image of the object.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention provides a method of generating haptic interface experiences that is capable of generating haptic companions to existing two-dimensional images. The method exploits the dominance of visual over haptic in humans: human tactile, proprioceptive, and kinesthetic senses do not supply as much fine detail as human vision, and consequently haptic representations do not have to be as detailed as the corresponding visual images to be believable to a human user. An existing two-dimensional image can be used as the visual component of a human-computer interface. A three-dimensional haptic model that is topologically similar to the image can be selected, where topological similarity means that the haptic model provides an acceptable approximation to important characteristics of the haptic experience desired to accompany the two-dimensional image. A relationship can then be established between the image in the visual component of the interface and the haptic model in the haptic component of the interface such that interaction with the image in the visual component is linked with interaction with the haptic model in the haptic component. As an example, a two-dimensional image of a ball can have a haptic model of a sphere associated therewith, and the center and radius established as a relationship such that visual cursor motion at the boundary of the image of the two-dimensional image of the ball is linked with haptic force feedback as the cursor encounters the surface of the haptic model.
-
Citations
19 Claims
-
1. A method of generating a three-dimensional haptic component of a human-computer interface corresponding to a two-dimensional image of an object, comprising:
-
a) Selecting from a library of haptic models an initial haptic model that is topologically similar to the object;
b) Establishing correspondence between a set of correspondence points in the three-dimensional initial haptic model and a set of correspondence points in the two-dimensional image of the object;
c) Generating a final haptic model by modifying the initial haptic model so that the two-dimensional projection of the correspondence points in the final haptic model are substantially aligned with the correspondence points in the two-dimensional image of the object. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method of providing a human-computer interface comprising a two-dimensional visual space and a generated three-dimensional haptic space;
- comprising;
a) Selecting from a library of haptic models an initial haptic model that is topologically similar to the object;
b) Establishing correspondence between a set of correspondence points in the three-dimensional initial haptic model and a set of correspondence points in the two-dimensional image of the object;
c) Generating a final haptic model by modifying the initial haptic model so that the two-dimensional projection of the correspondence points in the final haptic model are substantially aligned with the correspondence points in the two-dimensional image of the object. d) Establishing a correspondence between a haptic cursor in the haptic space and a visual cursor in the visual space;
e) changing the haptic cursor position and visual cursor position responsive to user input;
f) Providing force feedback to the user according to the haptic model and the position of the haptic cursor relative to the haptic model. - View Dependent Claims (8)
- comprising;
-
9. A method of generating a haptic model corresponding to an object in a visual image, comprising:
-
a) Selecting a haptic model from a set of haptic models, wherein the selected haptic model approximates desired haptic aspects of the object;
b) Establishing a correspondence between features of the selected haptic model and the representation of the object in the image; and
c) Generating a haptic model from the selected haptic model and the correspondence. - View Dependent Claims (10, 11, 12)
-
-
13. A method of generating a haptic model corresponding to a plurality of objects in a visual image, comprising, for each object in the visual image:
-
a) Selecting a haptic model from a set of haptic models, wherein the selected haptic model approximates desired haptic aspects of the object;
b) Establishing a correspondence between features of the selected haptic model and the representation of the object in the image; and
c) Generating a haptic model from the selected haptic model and the correspondence.
-
-
14. A method of generating a three-dimensional haptic component of a human-computer interface corresponding to a two-dimensional image of an object, comprising:
-
a) Selecting from a library of haptic models an initial haptic model that is topologically similar to the object;
b) Establishing correspondence between a set of correspondence points in the three-dimensional initial haptic model and a set of correspondence points in the two-dimensional image of the object;
c) Determining an error between the two dimensional projection of a haptic model and the two-dimensional image of the object, where the haptic model is determined by applying a set of parameterized operations to the initial haptic model;
d) Determining parameters for the parameterized operations that produce a haptic model corresponding to an error within an error bound.
-
-
15. A method of generating a three-dimensional haptic component of a human-computer interface corresponding to a two-dimensional image, comprising:
-
a) Selecting from a library of haptic models a three-dimensional haptic model that is topologically similar to the object;
b) Establishing a relationship between the two-dimensional image and the three-dimensional haptic model such that interaction with the two-dimensional image is linked to interaction with the three-dimensional haptic model. - View Dependent Claims (16, 17, 18, 19)
-
Specification