Transmission system, transmission terminal, and transmission method

• US 10,129,303 B2
• Filed: 10/08/2015
• Issued: 11/13/2018
• Est. Priority Date: 10/17/2014
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Morita, Kenichiro, Yamamoto, Yohei, Imai, Takuya, Nagamine, Shoh, Shiro, Hideki
• Primary Examiner(s): Patel, Hemant S
• Application Number:
  US14/878,361
• Publication Number:
  US 20160112675A1
• Time in Patent Office: 1,132 Days
• Field of Search: 348 1401- 1416, 370259-271, 370351-357, 37920101, 37920201-20701, 709201-207, 709217-248
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

There is provided a transmission system transmitting at least one of image data and audio data among a plurality of transmission terminals. A first transmission terminal includes a state detector that detects whether a user is present therearound, and a controller that controls to transmit correspondence data corresponding to a result detected by the state detector to a second transmission terminal when a state detected by the state detector changes. The second transmission terminal changes quality of at least one of the image data and the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data and transmits at least one of the image data and the audio data when the second transmission terminal receives the correspondence data.

Claims

1. A transmission system transmitting at least one of image data and audio data among a plurality of transmission terminals, the transmission system comprising:

a first transmission terminal including

a state detector configured to detect whether or not a user is present around the first transmission terminal, and

first processing circuitry configured to transmit, to a second transmission terminal, correspondence data corresponding to a state detected by the state detector, when the state detected by the state detector changes; and

the second transmission terminal including

second processing circuitry configured to, when the second processing circuitry receives the correspondence data, change a resolution of the image data into a predetermined maximum resolution, and transmit, to the first transmission terminal, pieces of the changed image data at resolutions lowered hierarchically from the maximum resolution as a reference.

2. The transmission system according to claim 1, wherein

the first processing circuitry is further configured to change a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal, in accordance with the correspondence data, and transmit the at least one of the other image data and the other audio data having the changed quality, when the state detected by the state detector changes.

3. The transmission system according to claim 1, wherein

the second processing circuitry is further configured to transmit at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

the relay device changes a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmits at least one of the image data and the audio data having the changed quality to only the first transmission terminal that has transmitted the correspondence data.

4. The transmission system according to claim 1, wherein

the first transmission terminal further includes a camera that performs image capturing, and

the state detector is configured to detect that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

5. The transmission system according to claim 1, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the state detector is configured to detect that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

6. The transmission system according to claim 1, wherein

when the second transmission terminal receives the correspondence data, the second processing circuity is configured to change a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmit the changed audio data.

7. A transmission terminal, comprising:

a transmitter configured to transmit data to an other transmission terminal, and

processing circuitry configured to change a resolution of image data into a predetermined maximum resolution, and transmit, to the other transmission terminal, pieces of the changed image data at resolutions lowered hierarchically from the maximum resolution as a reference in accordance with correspondence data received from the other transmission terminal and corresponding to a result of detection of a change of a state indicating whether or not a user is present around the other transmission terminal, in response to the transmission terminal receiving the correspondence data from the other transmission terminal.

8. A transmission method in which at least one of image data and audio data is transmitted among a plurality of transmission terminals, the transmission method comprising:

detecting, by a first transmission terminal, whether or not a user is present around the first transmission terminal; and

transmitting, from the first transmission terminal to a second transmission terminal, correspondence data corresponding to a detected state, when the detected state changes; and

when the second transmission terminal receives the correspondence data, changing a resolution of the image data into a predetermined maximum resolution, and transmitting, to the first transmission terminal, pieces of the changed image data at resolutions lowered hierarchically from the maximum resolution as a reference.

9. The transmission method according to claim 8, further comprising:

changing, by the first transmission terminal, a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal in accordance with the correspondence data, and transmitting, by the first transmission terminal, the at least one of the other image data and the other audio data having the changed quality, when the detected state changes.

10. The transmission method according to claim 8, further comprising:

transmitting, by the second transmission terminal, at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

changing, by the relay device, a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmitting, by the relay device, at least one of the image data and the audio data to only the first transmission terminal that has transmitted the correspondence data.

11. The transmission method according to claim 8, therein

the first transmission terminal includes a camera that performs image capturing, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

12. The transmission method according to claim 8, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

13. The transmission method according to claim 8, further comprising:

changing, by the second transmission terminal, a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmitting, by the second transmission terminal, the changed audio data, when the second transmission terminal receives the correspondence data.

14. A transmission system transmitting at least one of image data and audio data among a plurality of transmission terminals, the transmission system comprising:

a first transmission terminal including

a state detector configured to detect whether or not a user is present around the first transmission terminal, and

first processing circuitry configured to transmit, to a second transmission terminal, correspondence data corresponding to a state detected by the state detector, when the state detected by the state detector changes; and

the second transmission terminal including

second processing circuitry configured to, when the second processing circuitry receives the correspondence data, change a frame rate of the image data into a predetermined maximum frame rate, and transmit, to the first transmission terminal, pieces of the changed image data obtained by hierarchical thinning using the maximum frame rate as a reference.

17. The transmission system of claim 14, wherein

the first processing circuitry is further configured to change a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal, in accordance with the correspondence data, and transmit the at least one of the other image data and the other audio data having the changed quality, when the state detected by the state detector changes.

18. The transmission system of claim 14, wherein

the second processing circuitry is further configured to transmit at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

the relay device changes a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmits at least one of the image data and the audio data having the changed quality to only the first transmission terminal that has transmitted the correspondence data.

19. The transmission system of claim 14, wherein

the first transmission terminal further includes a camera that performs image capturing, and

the state detector is configured to detect that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

20. The transmission system of claim 14, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the state detector is configured to detect that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

21. The transmission system of claim 14, wherein

when the second transmission terminal receives the correspondence data, the second processing circuity is configured to change a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmit the changed audio data.

15. A transmission system transmitting at least one of image data and audio data among a plurality of transmission terminals, the transmission system comprising:

a first transmission terminal including

a state detector configured to detect whether or not a user is present around the first transmission terminal, and

first processing circuitry configured to transmit, to a second transmission terminal, correspondence data corresponding to a state detected by the state detector, when the state detected by the state detector changes; and

the second transmission terminal including

second processing circuitry configured to, when the second processing circuitry receives the correspondence data, transmit, to the first transmission terminal, only layers in accordance with a predetermined quality from multilayered time-axis data using a predetermined frame rate of the image data as a reference.

22. The transmission system of claim 15, wherein

the first processing circuitry is further configured to change a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal, in accordance with the correspondence data, and transmit the at least one of the other image data and the other audio data having the changed quality, when the state detected by the state detector changes.

23. The transmission system of claim 15, wherein

the second processing circuitry is further configured to transmit at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

the relay device changes a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmits at least one of the image data and the audio data having the changed quality to only the first transmission terminal that has transmitted the correspondence data.

24. The transmission system of claim 15, wherein

the first transmission terminal further includes a camera that performs image capturing, and

the state detector is configured to detect that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

25. The transmission system of claim 15, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the state detector is configured to detect that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

26. The transmission system of claim 15, wherein

when the second transmission terminal receives the correspondence data, the second processing circuity is configured to change a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmit the changed audio data.

16. A transmission system transmitting at least one of image data and audio data among a plurality of transmission terminals, the transmission system comprising:

a first transmission terminal including

a state detector configured to detect whether or not a user is present around the first transmission terminal, and

first processing circuitry configured to transmit, to a second transmission terminal, correspondence data corresponding to a state detected by the state detector, when the state detected by the state detector changes; and

the second transmission terminal including

second processing circuitry configured to, when the second processing circuitry receives the correspondence data, change color information of the image data into high quality, and transmit, to the first transmission terminal, color image data, or change the color information of the image data into low quality, and transmit, to the first transmission terminal, monochrome image data.

27. The transmission system of claim 16, wherein

the first processing circuitry is further configured to change a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal, in accordance with the correspondence data, and transmit the at least one of the other image data and the other audio data having the changed quality, when the state detected by the state detector changes.

28. The transmission system of claim 16, wherein

the second processing circuitry is further configured to transmit at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

the relay device changes a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmits at least one of the image data and the audio data having the changed quality to only the first transmission terminal that has transmitted the correspondence data.

29. The transmission system of claim 16, wherein

the first transmission terminal further includes a camera that performs image capturing, and

the state detector is configured to detect that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

30. The transmission system of claim 16, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the state detector is configured to detect that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

31. The transmission system of claim 16, wherein

when the second transmission terminal receives the correspondence data, the second processing circuity is configured to change a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmit the changed audio data.

32. A transmission terminal, comprising:

a transmitter configured to transmit image data to an other transmission terminal, and

processing circuitry configured to change a frame rate of the image data into a predetermined maximum frame rate, and transmit, to the other transmission terminal, pieces of the changed image data obtained by hierarchical thinning using the maximum frame rate as a reference in accordance with correspondence data received from the other transmission terminal and corresponding to a result of detection of a change of a state indicating whether or not a user is present around the other transmission terminal, in response to the transmission terminal receiving the correspondence data from the other transmission terminal.

33. A transmission terminal, comprising:

a transmitter configured to transmit image data to an other transmission terminal, and

processing circuitry configured to transmit, to the other transmission terminal, only layers in accordance with a predetermined quality from multilayered time-axis data using a predetermined frame rate of the image data as a reference in accordance with correspondence data received from the other transmission terminal and corresponding to a result of detection of a change of a state indicating whether or not a user is present around the other transmission terminal, in response to the transmission terminal receiving the correspondence data from the other transmission terminal.

34. A transmission terminal, comprising:

a transmitter configured to transmit image data to an other transmission terminal, and

processing circuitry configured to change color information of the image data into high quality, and transmit, to the other transmission terminal, color image data, or change the color information of the image data into low quality, and transmit, to the other transmission terminal, monochrome image data in accordance with correspondence data received from the other transmission terminal and corresponding to a result of detection of a change of a state indicating whether or not a user is present around the other transmission terminal, in response to the transmission terminal receiving the correspondence data from the other transmission terminal.

35. A transmission method in which at least one of image data and audio data is transmitted among a plurality of transmission terminals, the transmission method comprising:

detecting, by a first transmission terminal, whether or not a user is present around the first transmission terminal; and

transmitting, from the first transmission terminal to a second transmission terminal, correspondence data corresponding to a detected state, when the detected state changes; and

when the second transmission terminal receives the correspondence data, changing a frame rate of the image data into a predetermined maximum frame rate, and transmit, to the first transmission terminal, pieces of the changed image data obtained by hierarchical thinning using the maximum frame rate as a reference.

38. The transmission method of claim 35, further comprising:

changing, by the first transmission terminal, a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal in accordance with the correspondence data, and transmitting, by the first transmission terminal, the at least one of the other image data and the other audio data having the changed quality, when the detected state changes.

39. The transmission method of claim 35, further comprising:

transmitting, by the second transmission terminal, at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

changing, by the relay device, a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmitting, by the relay device, at least one of the image data and the audio data to only the first transmission terminal that has transmitted the correspondence data.

40. The transmission method of claim 35, wherein

the first transmission terminal includes a camera that performs image capturing, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

41. The transmission method of claim 35, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

42. The transmission method of claim 35, further comprising:

changing, by the second transmission terminal, a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmitting, by the second transmission terminal, the changed audio data, when the second transmission terminal receives the correspondence data.

36. A transmission method in which at least one of image data and audio data is transmitted among a plurality of transmission terminals, the transmission method comprising:

detecting, by a first transmission terminal, whether or not a user is present around the first transmission terminal; and

transmitting, from the first transmission terminal to a second transmission terminal, correspondence data corresponding to a detected state, when the detected state changes; and

when the second transmission terminal receives the correspondence data, transmit, to the first transmission terminal, only layers in accordance with a predetermined quality from multilayered time-axis data using a predetermined frame rate of the image data as a reference.

43. The transmission method of claim 36, further comprising:

changing, by the first transmission terminal, a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal in accordance with the correspondence data, and transmitting, by the first transmission terminal, the at least one of the other image data and the other audio data having the changed quality, when the detected state changes.

44. The transmission method of claim 36, further comprising:

transmitting, by the second transmission terminal, at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

changing, by the relay device, a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmitting, by the relay device, at least one of the image data and the audio data to only the first transmission terminal that has transmitted the correspondence data.

45. The transmission method of claim 36, wherein

the first transmission terminal includes a camera that performs image capturing, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

46. The transmission method of claim 36, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

47. The transmission method of claim 36, further comprising:

changing, by the second transmission terminal, a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmitting, by the second transmission terminal, the changed audio data, when the second transmission terminal receives the correspondence data.

37. A transmission method in which at least one of image data and audio data is transmitted among a plurality of transmission terminals, the transmission method comprising:

detecting, by a first transmission terminal, whether or not a user is present around the first transmission terminal; and

transmitting, from the first transmission terminal to a second transmission terminal, correspondence data corresponding to a detected state, when the detected state changes; and

when the second transmission terminal receives the correspondence data, changing color information of the image data into high quality, and transmitting, to the first transmission terminal, color image data, or changing the color information of the image data into low quality, and transmitting, to the first transmission terminal, monochrome image data.

48. The transmission method of claim 37, further comprising:

changing, by the first transmission terminal, a quality of at least one of other image data and other audio data that is to be transmitted to the second transmission terminal in accordance with the correspondence data, and transmitting, by the first transmission terminal, the at least one of the other image data and the other audio data having the changed quality, when the detected state changes.

49. The transmission method of claim 37, further comprising:

transmitting, by the second transmission terminal, at least one of the image data and the audio data to the first transmission terminal through a relay device relaying at least one of the image data and the audio data among the transmission terminals, and

changing, by the relay device, a quality of at least one of the image data and the audio data in accordance with the correspondence data, and transmitting, by the relay device, at least one of the image data and the audio data to only the first transmission terminal that has transmitted the correspondence data.

50. The transmission method of claim 37, wherein

the first transmission terminal includes a camera that performs image capturing, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when a change amount between frames of an image captured by the camera exceeds a certain threshold or when a region of a face of a person detected from the image captured by the camera exceeds a certain size.

51. The transmission method of claim 37, wherein

the first transmission terminal further includes an audio input unit acquiring audio input, a sensor detecting presence of an object or a person, or an operation input receiver receiving operation input, and

the transmission method further comprises detecting that a user is present around the first transmission terminal when the audio input acquired by the audio input unit exceeds a certain threshold, when a period of time during which the sensor detects the presence of the object or the person exceeds a certain threshold, or when the operation input receiver receives the operation input.

52. The transmission method of claim 37, further comprising:

changing, by the second transmission terminal, a quality of the audio data that is transmitted to the first transmission terminal in accordance with the correspondence data by changing a sampling rate of the audio data, and transmitting, by the second transmission terminal, the changed audio data, when the second transmission terminal receives the correspondence data.