Interview system, server system, server device, information terminal, interview method, information processing method, and program

• US 9,679,109 B2
• Filed: 12/29/2015
• Issued: 06/13/2017
• Est. Priority Date: 01/06/2015
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Higashi, Haruomi
• Primary Examiner(s): WOO, STELLA L
• Application Number:
  US14/982,168
• Publication Number:
  US 20160196402A1
• Time in Patent Office: 532 Days
• Field of Search: 348 1401- 1416, 382128, 709204
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

An information processing system includes one or more information processing devices and controls bidirectional communication of image data and audio data between a first information terminal used by a first user and a second information terminal used by a second user. The information processing system includes a calculation unit analyzing the image data and the audio data on the second user received from the second information terminal and calculating difference information that indicates a difference between a current state and a past state of the second user; an image generation unit superimposing the difference information on the image data received from the second information terminal, such that the difference information is displayed around a field where an image of the second user is placed; and a transmission unit transmitting, to the first information terminal, the image data on which the difference information is superimposed and the audio data.

Claims

1. An information processing system which includes one or more information processing devices and controls bidirectional communication of first image data, second image data, first audio data, and second audio data between a first information terminal used by a first user and a second information terminal used by a second user, the information processing system comprising:

a processor configured to;

analyze, via a calculation unit, the second image data and the second audio data on the second user received from the second information terminal,

calculate, via the calculation unit, difference information that indicates a difference between a current state of the second user and a past state of the second user;

superimpose, via an image generation unit, the difference information on the second image data received from the second information terminal, such that the difference information is displayed around a field where an image of the second user is placed; and

arranging and displaying additional fields around where the image of the second user is displayed, the additional fields being at least one of a question field and an advice field, and

a transmission unit configured to transmit, to the first information terminal, the second image data on which the difference information is superimposed by the image generation unit and the second audio data received from the second information terminal.

2. The information processing system as claimed in claim 1, wherein the first image data received from the first information terminal is obtained by an imaging unit disposed in proximity to a display screen of the first information terminal, the display screen displaying the second image data on which the difference information is superimposed by the image generation unit, the imaging unit facing a display direction of the display screen as a photographing direction.

3. The information processing system as claimed in claim 1, wherein the image generation unit is configured to extract, from the difference information, category information that matches a category specified by the first information terminal, and superimposes the category information on the second image data received from the second information terminal.

4. The information processing system as claimed in claim 1, wherein the image generation unit is configured to superimpose the difference information on the second image data received from the second information terminal, such that the difference information is classified into a plurality of fields and displayed therein, the plurality of fields being provided around the field where the image of the second user is placed.

5. The information processing system as claimed in claim 4, wherein the image generation unit is configured to superimpose the difference information on the second image data received from the second information terminal, the difference information being classified into one of the plurality of fields specified for display by the first information terminal.

6. The information processing system as claimed in claim 4, wherein

the image generation unit is configured to superimpose the difference information on the first image data received from the first information terminal, the difference information being classified into one of the plurality of fields specified for sharing by the first information terminal, such that the difference information is displayed around a field where an image of the first user is placed, and

the transmission unit is configured to transmit, to the second information terminal, the first image data on which the difference information is superimposed by the image generation unit, the difference information being classified into the one of the plurality of fields specified for sharing, and the first audio data received from the first information terminal.

7. The information processing system as claimed in claim 4, wherein if the first information terminal specifies display of detailed information in a predetermined field among the plurality of fields, the image generation unit superimposes original information on the second image data received from the second information terminal, the original information being used by the calculation unit in order to calculate the difference information classified into the predetermined field.

8. The information processing system as claimed in claim 1,

further comprising:

a storage unit configured to store information indicating the past state of the second user, the information indicating past state of the second user being used by the calculation unit in order to calculate the difference information.

9. The information processing system as claimed in claim 1, wherein the question field is displayed above the image of the second user on the display.

10. The information processing system as claimed in claim 1, wherein the advice field is displayed at a side of the image of the second user on the display.

11. An information processing method in an information processing system which includes one or more information processing devices and controls bidirectional communication of image data and audio data between a first information terminal used by a first user and a second information terminal used by a second user, the information processing method comprising:

analyzing the image data and the audio data on the second user received from the second information terminal and calculating difference information that indicates a difference between a current state of the second user and a past state of the second user;

superimposing the difference information on the image data received from the second information terminal, such that the difference information is displayed around a field where an image of the second user is placed;

arranging and displaying additional fields around where the image of the second user is displayed, the additional fields being at least one of a question field and an advice field, and

transmitting, to the first information terminal, the image data on which the difference information is superimposed in the superimposing and the audio data received from the second information terminal.

12. An information processing apparatus that controls bidirectional communication of image data and audio data between a first information terminal used by a first user and a second information terminal used by a second user, the information processing apparatus comprising:

a processor configured to;

analyze, via a calculation unit, the image data and the audio data on the second user received from the second information terminal and calculates difference information that indicates a difference between a current state of the second user and a past state of the second user;

superimpose, via an image generation unit, the difference information on the image data received from the second information terminal, such that the difference information is displayed around a field where an image of the second user is placed; and

arrange and display additional fields around where the image of the second user is displayed, the additional fields being at least one of a question field and an advice field, and

a transmission unit that transmits, to the first information terminal, the image data on which the difference information is superimposed by the image generation unit and the audio data received from the second information terminal.