INFORMATION PROCESSING DEVICE, METHOD, AND COMPUTER PROGRAM

• US 20180203509A1
• Filed: 08/31/2016
• Published: 07/19/2018
• Est. Priority Date: 09/08/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: YAMANO, Ikuo, NAKAGAWA, Yusuke, YOKOYAMA, Ryo, KOMORI, Akihiro, NOZAKI, Takashi
• Granted Patent: US 10,331,214 B2
• Time in Patent Office: Days
• CPC Class Codes: A41D 1/002 adapted to accommodate electronic equipment patients' garments for medical monitoring A41D13/1281; luminous ornaments A41D27/085
• CPC Class Codes: A41D 1/02 Jackets
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/23 for interfacing with the game device, e.g. specific interfaces between game controller and console
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/24 Constructional details thereof, e.g. game controllers with detachable joystick handles
• CPC Class Codes: A63F 13/285 Generating tactile feedback signals via the game input device, e.g. force feedback
• CPC Class Codes: A63F 13/31 Communication aspects specific to video games, e.g. between several handheld game devices at close range
• CPC Class Codes: A63F 13/426 involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/577 using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2250/166 Garments
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0172 : characterised by optical features
• CPC Class Codes: G06F 1/163 : Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/014 : Force feedback applied to GUI
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 : Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0487 : using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: H04M 19/04 : the ringing-current being generated at the substations

Abstract

There is provided an information processing device to allow a user to receive haptic feedback with a more sense of presence, the information processing device including: a virtual space data generating unit configured to generate data related to a virtual space including a virtual object having an attribute; a listener placing unit configured to place a listener for detecting a contact with the virtual object; a virtual object in which the listener is placed; and a haptic data generating unit configured to generate haptic data for causing a haptic device to be operated on a basis of at least one of attribute information of the virtual object and attribute information of another virtual object when the virtual object comes into contact with the other virtual object.

Claims

1. An information processing device, comprising:

a virtual space data generating unit configured to generate data related to a virtual space including a virtual object having an attribute;

a listener placing unit configured to place a listener for detecting a contact with the virtual object;

a virtual object in which the listener is placed; and

a haptic data generating unit configured to generate haptic data for causing a haptic device to be operated on a basis of at least one of attribute information of the virtual object and attribute information of another virtual object when the virtual object comes into contact with the other virtual object.

2. The information processing device according to claim 1,

wherein the virtual object in which the listener is placed is the virtual object manipulated by a user.

3. The information processing device according to claim 1,

wherein the haptic data is data related to vibration.

4. The information processing device according to claim 2,

wherein the virtual space data generating unit forms the virtual object so that an attribute is associated with the virtual object.

5. The information processing device according to claim 4,

wherein the attribute information of the virtual object includes at least one of a mass, a degree of rigidity, a material, a size, a shape, a position, and a speed of the virtual object.

6. The information processing device according to claim 5,

wherein the haptic data generating unit generates the haptic data on a basis of the attribute of the virtual object manipulated by the user.

7. The information processing device according to claim 5,

wherein the haptic data generating unit generates the haptic data on a basis of the attribute of the other virtual object different from the virtual object manipulated by the user.

8. The information processing device according to claim 5,

wherein the haptic data generating unit generates the haptic data on a basis of both the attribute of the virtual object manipulated by the user and the attribute of the other virtual object different from the virtual object manipulated by the user.

9. The information processing device according to claim 1,

wherein the haptic data generating unit further generates the haptic data in accordance with a relative speed or a contact position between the virtual object in which the listener is placed and another virtual object.

10. The information processing device according to claim 1,

wherein the haptic data generating unit generates the haptic data based on a shock generation source that exists at a position away from the virtual object in which the listener is placed.

11. The information processing device according to claim 10,

wherein the haptic data generating unit generates the haptic data on a basis of a medium between the virtual object in which the listener is placed and the shock generation source.

12. The information processing device according to claim 1,

wherein the listener placing unit places a plurality of the listeners in the virtual object, and

the haptic data generating unit generates the haptic data for the haptic device corresponding to another listener among the plurality of listeners on a basis of the haptic data for the haptic device corresponding to at least one of the plurality of listeners and a coupling relation between the plurality of listeners.

13. The information processing device according to claim 12,

wherein the coupling relation relates to a propagation characteristic.

14. The information processing device according to claim 13,

wherein the propagation characteristic relates to a propagation speed or attenuation of propagation.

15. The information processing device according to claim 1,

wherein the haptic data generating unit further generates the haptic data on a basis of information provided from a line-of-sight detecting unit configured to detect a line of sight of a user.

16. The information processing device according to claim 15,

wherein the haptic data generating unit generates the haptic data on a basis of a contact between the virtual object in a field of view of the user in the virtual space and the virtual object manipulated by the user.

17. The information processing device according to claim 1,

wherein the haptic data is data related to an electric stimulus or heat.

18. A method, comprising:

generating data related to a virtual space including a virtual object having an attribute;

placing a listener for detecting a contact with the virtual object;

causing the listener to be placed in the virtual object; and

generating haptic data for causing a haptic device to be operated on a basis of at least one of attribute information of the virtual object and attribute information of another virtual object when the virtual object comes into contact with the other virtual object.

19. A computer program causing a processor to execute

generating data related to a virtual space including a virtual object having an attribute,

placing a listener for detecting a contact with the virtual object,

causing the listener to be placed in the virtual object, and

generating haptic data for causing a haptic device to be operated on a basis of at least one of attribute information of the virtual object and attribute information of another virtual object when the virtual object comes into contact with the other virtual object.