INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20190320143A1
• Filed: 04/26/2017
• Published: 10/17/2019
• Est. Priority Date: 07/28/2016
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: IZUMIHARA, Atsushi, SAKAI, Yusuke
• Granted Patent: US 10,638,091 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

[Object] To provide an information processing device, an information processing method, and a program that can enable more comfortable communication by rendering distances to multiple communication partners by using three-dimensional expression for connection between spaces.

[Solution] An information processing device including: a reception unit configured to receive data from a communication destination; a generation unit configured to generate spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and a display control unit configured to perform control so as to display the generated spatial image information on a display unit.

Claims

1. An information processing device comprising:

a reception unit configured to receive data from a communication destination;

a generation unit configured to generate spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and

a display control unit configured to perform control so as to display the generated spatial image information on a display unit.

2. The information processing device according to claim 1, wherein the generation unit visualizes communication that has occurred between the plurality of communication destinations in the three-dimensional space.

3. The information processing device according to claim 2, wherein the generation unit visualizes a state of the communication.

4. The information processing device according to claim 3, wherein the generation unit calculates activity of conversation in the communication, and performs visualization display corresponding to the activity.

5. The information processing device according to claim 4, wherein the generation unit calculates the activity on a basis of at least one of conversation voice or video during conversation.

6. The information processing device according to claim 3, wherein the generation unit estimates a mood of conversation in the communication, and performs visualization display corresponding to the mood.

7. The information processing device according to claim 6, wherein the generation unit estimates the mood on a basis of at least one of conversation voice or video during conversation.

8. The information processing device according to claim 3, wherein the generation unit calculates activity of conversation and estimates a mood of conversation in the communication, and performs visualization display corresponding to the activity and the mood.

9. The information processing device according to claim 1, wherein the generation unit fits the captured image of the communication destination into an opening of a virtual object, and places the virtual object at the predetermined position in the three-dimensional space.

10. The information processing device according to claim 9, wherein the generation unit controls a distance to each virtual object placed in the three-dimensional space in accordance with a degree of exposure.

11. An information processing method comprising, by a processor:

receiving data from a communication destination;

generating spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and

performing control so as to display the generated spatial image information on a display unit.

12. A program causing a computer to function as:

a reception unit configured to receive data from a communication destination;

a generation unit configured to generate spatial image information placed at a predetermined position in a three-dimensional space by using captured images of a plurality of the communication destinations; and

a display control unit configured to perform control so as to display the generated spatial image information on a display unit.