COMMUNICATION SYSTEM FOR REMOTE COMMUNICATION

• US 20160212379A1
• Filed: 12/28/2015
• Published: 07/21/2016
• Est. Priority Date: 01/21/2015
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Ito, Yoshiharu
• Granted Patent: US 10,477,145 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/1089 by adding media; by removing media
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A communication system superimposes a mirror-image video obtained at another site and a document image on each other and projects the video and the document image on a screen. Here, the direction and amount of movement of the projected document image are obtained upon detection of an instruction to move the display position of the document image. Then, the both projected video and document image are moved in the obtained direction of movement by an amount corresponding to the obtained amount of movement. Also, the obtained direction and amount of movement are transmitted to the other site.

Claims

1. A communication system, comprising:

a projection unit configured to superimpose a mirror-image video obtained at another site and a document image on each other and project the video and the document image on a display unit;

a detection unit configured to detect an instruction from a user;

an image capture unit configured to capture an image of the user situated to face a display surface of the display unit;

an obtaining unit configured to obtain a direction and an amount of movement of the document image projected on the display unit in a case where the detection unit detects an instruction to move a display position of the document image;

a control unit configured to move both the video and the document image projected by the projection unit in the direction obtained by the obtaining unit by an amount corresponding to the amount of movement obtained by the obtaining unit; and

a transmission unit configured to transmit the direction and the amount of movement obtained by the obtaining unit to the other site.

2. The communication system according to claim 1, wherein

the obtaining unit further obtains information indicating either a first mode in which the display position of the document image is set individually or a second mode in which, upon movement of the display position of the document image, the document image at the other site is moved in synchronization with the movement, and

in a case where the information obtained by the obtaining unit indicates the first mode, the control unit moves both the video and the document image projected by the projection unit in the direction obtained by the obtaining unit by the amount corresponding to the amount of movement obtained by the obtaining unit.

3. The communication system according to claim 1, wherein

the obtaining unit further obtains information indicating either a first mode in which the display position of the document image is set individually or a second mode in which, upon movement of the display position of the document image, the document image at the other site is moved in synchronization with the movement, and

in a case where the information obtained by the obtaining unit indicates the second mode, the control unit moves the document image projected by the projection unit in the direction obtained by the obtaining unit by the amount corresponding to the amount of movement obtained by the obtaining unit.

7. The communication system according to claim 1, wherein the movement includes changing a display coordinate of the document image or the video displayed on the display unit.

8. The communication system according to claim 1, wherein the movement includes changing a display size of the document image or the video displayed on the display unit.

9. The communication system according to claim 1, wherein

the display unit is a semitransparent screen, and

the image capture unit captures the image of the user through the semitransparent screen from a back surface side of the semitransparent screen facing away from the user.

4. A communication system, comprising:

a projection unit configured to superimpose a mirror-image video obtained at another site and a document image on each other and project the video and the document image on a display unit;

a detection unit configured to detect an instruction from a user;

an image capture unit configured to capture an image of the user situated to face a display surface of the display unit;

a reception unit configured to receive a direction and an amount of movement of a display position of the document image from the other site; and

a control unit configured to move the video projected by the projection unit in a direction opposite the direction received by the reception unit by an amount corresponding to the amount of movement received by the reception unit.

5. The communication system according to claim 4, wherein

the reception unit further receives information indicating either a first mode in which the display position of the document image is set individually or a second mode in which, upon movement of the display position of the document image, the document image at the other site is moved in synchronization with the movement, and

in a case where the information received by the reception unit indicates the first mode, the control unit moves the video projected by the projection unit in the direction opposite the direction received by the reception unit by the amount corresponding to the amount of movement received by the reception unit.

6. The communication system according to claim 4, wherein

the reception unit further receives information indicating either a first mode in which the display position of the document image is set individually or a second mode in which, upon movement of the display position of the document image, the document image at the other site is moved in synchronization with the movement, and

in a case where the information received by the reception unit indicates the second mode, the control unit moves the document image projected by the projection unit in the same direction as the direction received by the reception unit by the amount corresponding to the amount of movement received by the reception unit.

10. A control method using a system, including

a projection unit configured to superimpose a mirror-image video obtained at another site and a document image on each other and project the video and the document image on a display unit,

a detection unit configured to detect an instruction from a user, and

an image capture unit configured to capture an image of the user situated to face a display surface of the display unit, comprising:

an obtaining step of obtaining a direction and an amount of movement of the document image projected on the display unit in a case where the detection unit detects an instruction to move a display position of the document image;

a moving step of moving both the video and the document image projected by the projection unit in the direction obtained in the obtaining step by an amount corresponding to the amount of movement obtained in the obtaining step; and

a transmitting step of transmitting the direction and the amount of movement obtained in the obtaining step to the other site.

11. A control method using a system, including

a projection unit configured to superimpose a mirror-image video obtained at another site and a document image on each other and project the video and the document image on a display unit,

a detection unit configured to detect an instruction from a user, and

an image capture unit configured to capture an image of the user situated to face a display surface of the display unit, comprising:

a receiving unit of receiving a direction and an amount of movement of a display position of the document image from the other site; and

a moving step of moving both the video projected by the projection unit in a direction opposite the direction received in the receiving step by an amount corresponding to the amount of movement received in the receiving step.

12. A non-transitory computer readable recording medium recording therein a program for a computer including

a projection unit configured to superimpose a mirror-image video obtained at another site and a document image on each other and project the video and the document image on a display unit,

a detection unit configured to detect an instruction from a user, and

an image capture unit configured to capture an image of the user situated to face a display surface of the display unit,

the program causing the computer to execute:

an obtaining procedure of obtaining a direction and an amount of movement of the document image projected on the display unit in a case where the detection unit detects an instruction to move a display position of the document image;

a controlling procedure of moving both the video and the document image projected by the projection unit in the direction obtained in the obtaining procedure by an amount corresponding to the amount of movement obtained in the obtaining procedure; and

a transmitting procedure of transmitting the direction and the amount of movement obtained in the obtaining procedure to the other site.