HAPTIC EXPERIENCE SERVICE METHOD AND SYSTEM

• US 20080186152A1
• Filed: 12/28/2007
• Published: 08/07/2008
• Est. Priority Date: 02/02/2007
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Park, Jun Seok, Han, Dong Won, Kyung, Ki Uk, Lee, Yong Hee
• Application Number:
  US11/966,623
• Publication Number:
  US 20080186152A1
• Time in Patent Office: Days
• US Class Current: 340/407.1
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

A haptic experience service method and system are provided. The haptic experience service system, includes: a haptic reproduction apparatus providing haptic information of a force and texture of a virtual object or environment to a user; a server defining a virtual environmental factor corresponding to a user-desired haptic experience service by using a haptic contents database constructed with an environmental factor definition package, generating an experience environment corresponding to the environmental factor, and generating a haptic data output value corresponding to an input data of the haptic reproduction apparatus in the experience environment by using an interaction value definition package and an apparatus definition variable of the haptic reproduction apparatus; and a client recognizing an access of the haptic reproduction apparatus, providing the apparatus definition variable of the haptic reproduction apparatus to the server by using an apparatus definition data package, displaying a visual data associated with the experience environment generated by the server, transmitting to the server an input data generated by a user'"'"'s manipulation and received from the haptic reproduction apparatus, receiving the haptic data output value interacted with the input data, and providing the haptic data output value to the haptic reproduction apparatus.

Accordingly, it is possible to efficiently provide the haptic information to the user.

Claims

1. A haptic experience service system, comprising:

a haptic reproduction apparatus providing haptic information of a force and texture of a virtual object or environment to a user

a server defining a virtual environmental factor corresponding to a user-desired haptic experience service by using a haptic contents database constructed with an environmental factor definition package, generating an experience environment corresponding to the environmental factor, and generating a haptic data output value corresponding to an input data of the haptic reproduction apparatus in the experience environment by using an interaction value definition package and an apparatus definition variable of the haptic reproduction apparatus; and

a client recognizing an access of the haptic reproduction apparatus, providing the apparatus definition variable of the haptic reproduction apparatus to the server by using an apparatus definition data package, displaying a visual data associated with the experience environment generated by the server, transmitting to the server an input data generated by a user'"'"'s manipulation and received from the haptic reproduction apparatus, receiving the haptic data output value interacted with the input data, and providing the haptic data output value to the haptic reproduction apparatus.

2. The haptic experience service system of claim 1, wherein the client comprises:

an apparatus definition unit including the apparatus definition data package to define variables of type and feature of the haptic reproduction apparatus;

an environmental factor definition unit allowing the user to select the virtual environmental factor corresponding to the user-desired haptic experience service; and

a controller providing the virtual environmental factor selected through the environmental factor definition unit to the server, displaying the visual data associated with the virtual experience environment provided from the server on a display screen, and transmitting the haptic data output value and the input data generated from the server and the haptic reproduction apparatus to the haptic reproduction apparatus and the server.

3. The haptic experience service system of claim 1, wherein the client transforms a coordinate system and a scale of the haptic data output value and the input data generated from the server and the haptic reproduction apparatus in reflection of a feature of the haptic reproduction apparatus by using a transformation matrix corresponding to the haptic data output value and the input data and transmits the transformed haptic data output value and input data to the haptic reproduction apparatus and the server.

4. The haptic experience service system of claim 1, wherein the server comprises:

a haptic contents database including the environmental factor definition package to define a virtual haptic experience environmental factor to be serviced to the user accessing the server through the client;

an experience environment definition unit defining the environmental factor selected by the user and generating the experience environment corresponding to the environmental factor; and

an interaction value definition unit including the interaction value definition package to generate the haptic data output value interacted with the input data by using the interaction value definition package when receiving the input data of the haptic reproduction apparatus requested to be applied to the experience environment.

5. The haptic experience service system of claim 1, wherein the server calculates a correlation between a previously calculated experience environment data and the input data by using the interaction value definition package to generate the haptic data output value.

6. The haptic experience service system of claim 1,

wherein each of the packages has an ID (identifier) unique to the package,

wherein each of the packages includes a plurality of classes having the same ID, and

wherein each of the classes includes a plurality of variables.

7. The haptic experience service system of claim 1,

wherein each of the packages is constructed with at least one of one file, one character string, a set of files, and a set of character strings,

wherein, in case of a package constructed with a file or files, features of elements are represented by using a markup language or a script, and

wherein, in case of a package constructed with a character string or character strings, internal elements are represented to be sequentially arranged.

8. The haptic experience service system of claim 1,

wherein the apparatus definition data package includes variables for defining a type and physical properties of an apparatus,

wherein the environmental factor definition package includes variables for a virtual object, an object-surface feature, and an environment of the object that are used for the haptic experience service,

wherein the interaction value definition package includes apparatus input/output data variables and haptic data calculation variables that are used to generate the haptic data output value.

9. The haptic experience service system of claim 8, wherein the apparatus definition data package includes:

a force feedback apparatus class including at least one of an apparatus name variable, a degree-of-freedom variable, an operating range variable, a resolution variable, a maximum output force variable, an output torque variable, a maximum output impedance variable, and a sampling frequency variable; and

a texture expression apparatus class including at least one of an apparatus name variable, a number-of-stimulus-pins variable, a pin array structure variable, a stimulus pin interval variable, a stimulus pin size variable, a stimulus pin maximum displacement variable, a frequency bandwidth variable, a stimulus pin supporting force variable, a stimulus pin maximum force variable, a maximum thermal conductivity variable, and a vibration output range variable.

10. The haptic experience service system of claim 8, wherein the environmental factor definition package includes:

an object class including at least one of a virtual object name variable, a geometrical shape variable, a mass variable, an elastic coefficient variable, a damping coefficient (viscosity coefficient) variable, and a position variable;

a surface feature class including at least one of an object-surface groove depth variable, a groove size variable, a grain direction variable, a grain density variable, a roughness variable, a friction variable, a temperature variable, a thermal conductivity variable, a pattern variable, and an interested region coordinate variable; and

an environmental condition class including a gravity amplitude variable, a gravitational direction variable, and a flow direction variable and a viscosity variable of a fluid in a space enclosing the object.

11. The haptic experience service system of claim 8, wherein the interaction value definition package includes:

an apparatus input/output data class including at least one of a position variable, a velocity variable, an acceleration variable, and a direction variable that are generated in the haptic reproduction apparatus and at least one of an output force variable and an output torque variable that are to be provided to the haptic reproduction apparatus; and

a haptic data calculation class including at least one of a haptic reproduction library variable, a collision determination variable, a force calculation value variable, a torque calculation value variable, a stimulus-pin displacement variable, a stimulus-pin force variable, and a stimulus-pin frequency variable.

12. The haptic experience service system of claim 1, wherein the haptic reproduction apparatus comprises:

a force feedback apparatus including a grip for providing a haptic sense of the virtual object or environment to the user, so that a force haptic sense associated with the virtual object and environment is provided to the user through the grip; and

a texture expression apparatus including a pin array having a plurality of pins for directly stimulating a skin of the user, so that a texture haptic sense is provided to the user through the pin array.

13. The haptic experience service system of claim 12, wherein the texture expression apparatus further comprises at least one of a vibration motor and a heat transfer device.

14. A haptic experience service system, comprising:

a haptic reproduction apparatus providing haptic information of a force and texture of a virtual object or environment to a user

a server defining a virtual environmental factor to be serviced to the user by using a haptic contents database constructed with an environmental factor definition package; and

a client recognizing an access of the haptic reproduction apparatus, generating an experience environment corresponding to the virtual environment factor, displaying a visual data associated with the experience environment, generating a haptic data output value interacted with the input data generated by a user'"'"'s manipulation and received from the haptic reproduction apparatus by using an interaction value definition package, and providing the haptic data output value to the haptic reproduction apparatus.

15. The haptic experience service system of claim 14, wherein the client comprises:

an apparatus definition unit including the apparatus definition data package to select variables of type and feature of the haptic reproduction apparatus;

an environmental factor definition unit selecting the virtual environmental factor corresponding to the user-desired haptic experience service;

a controller transmitting the virtual environmental factor selected by the environmental factor definition unit to the server to generate the experience environment corresponding to the virtual environmental factor, extracting a visual data associated with the experience environment to display the visual data, and transmitting to the haptic reproduction apparatus the haptic data output value corresponding to the input data of the haptic reproduction apparatus in cooperation with the apparatus definition unit and the interaction value definition unit; and

an interaction value definition unit including the interaction value definition package to define the haptic data output value interacted with the input data provided from the haptic reproduction apparatus.

16. The haptic experience service system of claim 14, wherein the client calculates a correlation between a previously calculated experience environment data and the input data by using the interaction value definition package to generate the haptic data output value.

17. The haptic experience service system of claim 14, wherein the server comprises:

a haptic contents database including the environmental factor definition package to allow the user accessing the server through the client to select the virtual environmental factor corresponding to the user-desired haptic experience service; and

an environmental factor definition unit defining the virtual environmental factor selected by the user to provide the virtual environmental factor to the client.

18. A haptic experience service method in a haptic experience service system, comprising:

a user who desires to receive a haptic experience service selecting and inputting a type and feature of a haptic reproduction apparatus through a client connected to the haptic reproduction apparatus;

the client generating an apparatus definition data package based on the type and feature of the haptic reproduction apparatus and transmitting the apparatus definition data package to the server;

the user accessing the server through the client and selecting a virtual environmental factor corresponding to a user-desired virtual haptic experience service;

the server defining the virtual environmental factor according to the user'"'"'s selection, generating a virtual experience environment corresponding to the virtual environmental factor, and providing a visual data of the virtual experience environment to the client;

the client displaying the visual data on a display screen and transmitting an input data received from the haptic reproduction apparatus to the server under the control of the user who checks the visual data; and

the server generating a haptic data output value interacted with the input data and providing the haptic data output value to the haptic reproduction apparatus through the client.

19. The haptic experience service method of claim 18, wherein, in the server generating the haptic data output value, the server calculates a correlation between a previously calculated experience environment data and the input data by using an interaction value definition package including apparatus input/output data variables and haptic data calculation variables to generate the haptic data output value.

20. The haptic experience service method of claim 18, wherein, in the client transmitting the input data to the server, the client transforms a coordinate system and a scale of the input data in reflection of the feature of the haptic reproduction apparatus by using a transformation matrix corresponding to the input data and transmits the transformed input data to the server.

21. The haptic experience service method of claim 18, wherein, in the client transmitting the haptic data output value to the haptic reproduction apparatus, the client transforms a coordinate system and a scale of the haptic data output value in reflection of the feature of the haptic reproduction apparatus by using a transformation matrix corresponding to the haptic data output value, and transmits the transformed haptic data output value to the server.

22. The haptic experience service method of claim 18, wherein, in the client transmitting the apparatus definition data package to the server, the client transmits the apparatus definition data package in a format of file or character string to the server.

23. The haptic experience service method of claim 18, wherein, in the user selecting the virtual haptic experience environmental factor, the user accesses a haptic contents database of the server including variables for a virtual object, an object-surface feature, and an environment of the object that are used for the haptic experience service and selects an environmental factor variable included in the haptic contents database.

24. A haptic experience service method in a haptic experience service system, comprising:

a user who desires to receive a haptic experience service selecting and inputting a type and feature of a haptic reproduction apparatus through a client connected to the haptic reproduction apparatus;

the client generating an apparatus definition data package based on the type and feature of the haptic reproduction apparatus and transmitting the apparatus definition data package to the server;

the user accessing the server through the client and selecting a virtual environmental factor corresponding to a user-desired virtual haptic experience service, so that the server defines an environmental factor according to the user'"'"'s selection and provides the environmental factor to the client;

the client generating an experience environment corresponding to the environmental factor, extracting a visual data associated with the experience environment, and displaying the visual data on a display screen; and

the client generating a haptic data output value interacted with the input data received from the haptic reproduction apparatus under the control of the user and providing the haptic data output value to the haptic reproduction apparatus.

25. The haptic experience service method of claim 24, wherein, in the server providing the environmental factor to the client, the server generates an environmental factor data package and transmits the environmental factor data package to the client.

26. The haptic experience service method of claim 24, wherein, in the client generating the haptic data output value, the client calculates a correlation between a previously calculated experience environment data and the input data by using an interaction value definition package including apparatus input/output data variables and haptic data calculation variable to generate the haptic data output value.