Communication device and non-transitory computer-readable medium

• US 9,473,541 B2
• Filed: 11/21/2014
• Issued: 10/18/2016
• Est. Priority Date: 11/29/2013
• Status: Active Grant

• Current Assignee: Brother Kogyo Kabushiki Kaisha (Brother Industries Limited)
• Original Assignee: Brother Kogyo Kabushiki Kaisha (Brother Industries Limited)
• Inventors: Miyazawa, Jun
• Primary Examiner(s): Rinehart, Mark
• Assistant Examiner(s): Dewan, Sanjay K
• Application Number:
  US14/550,174
• Publication Number:
  US 20150156222A1
• Time in Patent Office: 697 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 43/087 Jitter
• CPC Class Codes: H04L 65/1046 Call controllers; Call servers
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A non-transitory computer-readable medium stores computer-readable instructions performing processes including a determination, a setting, a first generation, a second generation and a transmission operations. The determination operation determines whether a communication state is a first or second state based on at least one of transmission data transmitted by the communication device to a conference server and reception data received by the communication device from the conference server. The setting operation sets a combined time to a first or second period of time in response to the determination operation. The first generation operation generates sound data corresponding to the combined time, by sequentially compressing sampling data corresponding to the combined time in an order of storage in a first storage portion. The second generation operation generates a packet including the sound data. The transmission operation transmits the packet to the conference server at a cycle corresponding to the combined time.

Claims

1. A non-transitory computer-readable medium storing computer-readable instructions, the instructions, when executed by a processor of a communication device configured to connect a network, performing processes comprising:

a first judgment operation judging whether sampling data of sound for a period of time equal to or greater than a predetermined period of time is stored in a first storage portion;

a first generation operation sequentially generating, in response to the first judgment operation judging that the sampling data of sound for the period of time equal to or greater than the predetermined period of time is stored in the first storage portion, unit sound data by sequentially compressing the sampling data in the first storage portion for the predetermined period of time in an order of storage in the first storage portion;

a storage operation storing the unit sound data in a second storage portion;

a determination operation determining whether a communication state of the network is one of a first state and a second state different from the first state based on at least one of transmission data transmitted to the network and reception data received from the network;

a setting operation setting a combined time corresponding to a length of time of sound in sound data included in a single packet, the combined time being one of;

a first period of time when the determination operation determines that the communication state is the first state; and

a second period of time longer than the first period of time when the determination operation determines that the communication state is the second state;

a second judgment operation judging whether the unit sound data for a period of time equal to or greater than the combined time is stored in the second storage portion;

a second generation operation generating the packet including the unit sound data for the combined time in response to the second judgment operation judging that the unit sound data for the period of time equal to or greater than the combined time is stored in the second storage portion; and

a transmission operation transmitting, to at least one counterpart device at a cycle corresponding to the combined time, the packet generated by the second generation operation.

2. The non-transitory computer-readable medium according to claim 1, wherein the instructions, when executed by the processor of the communication device, perform the processes further comprising a measurement operation measuring first jitter, the first jitter indicating a degree of variation in at least one of a first delay time and a second delay time, the first delay time being from when the transmission data is transmitted to a conference server to when the transmission data is received by the conference server, and a second delay time being from when the reception data is transmitted by the conference server to when the reception data is received by the communication device, the conference server connected to the network and conducting a teleconference among the communication device and a plurality of the counterpart devices, and wherein

the determination operation determines that the communication state is the first state when the first jitter is a first value, and determines that the communication state is the second state when the first jitter is a second value greater than the first value.

3. The non-transitory computer-readable medium according to claim 2, wherein the instructions, when executed by the processor of the communication device, perform the processes further comprising an acquisition operation acquiring a plurality of second jitter indicating a degree of variation in at least one of a plurality of third delay times and a plurality of fourth delay times, each of the third delay times being from when each of the plurality of counterpart devices transmits the transmission data to the conference server to when the conference server receives the transmission data, and each of the fourth delay times being from when the reception data is transmitted by the conference server to when the reception data is received by each of the plurality of counterpart devices, and wherein

the determination operation determines that the communication state is the first state when a largest jitter, from among the first jitter and the second jitter, is a first value, and determines that the communication state is the second state when the largest jitter is a second value that is larger than the first value.

4. The non-transitory computer-readable medium according to claim 3, wherein

the largest jitter is selected from among a plurality of combined jitter, each of the combined jitter being defined by combining the first jitter and one of the plurality of the second jitter.

5. The non-transitory computer-readable medium according to claim 1, wherein the instructions, when executed by the processor of the communication device, perform the processes further comprising a third judgment operation judging whether document data is being transmitted to at least one of the counterpart devices, the document data indicating a document to be shared in a teleconference, and wherein

the determination operation determines that the communication state is the first state in response to the third judgment operation judging that the document data is not being transmitted, and determines that the communication state is the second state in response to the third judgment operation judging that the document data is being transmitted.

6. The non-transitory computer-readable medium according to claim 1, wherein the instructions, when executed by the processor of the communication device, perform the processes further comprising a third judgment operation judging whether intra-frame compressed image data is being transmitted to at least one of the counterpart devices in a teleconference, and wherein

the determination operation determines that the communication state is the first state in response to the third judgment operation judging that the intra-frame compressed image data is not being transmitted, and determines that the communication state is the second state in response to the third judgment operation judging that the intra-frame compressed image data is being transmitted.

7. The non-transitory computer-readable medium according to claim 1, wherein

the first generation operation generates the unit sound data at a first cycle, and wherein

the transmission operation transmits the packet at one of a plurality of second cycles that are each an integral multiple of the first cycle.

8. The non-transitory computer-readable medium according to claim 1, wherein the instructions, when executed by the processor of the communication device, perform the processes further comprising a third judgment operation judging whether the communication state has changed, wherein

the determination operation determines that the communication state is one of the first state and the second state in response to the third judgment operation judging that the communication state has changed.

9. A non-transitory computer-readable medium storing computer-readable instructions, the instructions, when executed by a processor of a communication device, performing processes comprising:

a determination operation determining whether a communication state with a conference server via a network is one of a first state and a second state different from the first state based on at least one of transmission data transmitted by the communication device to the conference server and reception data received by the communication device from the conference server;

a setting operation setting a first period of time as a combined time in response to the determination operation determining that the communication state is the first state, and setting, as the combined time, a second period of time that is longer than the first period of time in response to the determination operation determining that the communication state is the second state;

a first generation operation generating, from sampling data of sound stored in a first storage portion, sound data for the combined time, by sequentially compressing the sampling data for the combined time in an order of storage in the first storage portion;

a second generation operation generating a packet including the sound data; and

a transmission operation transmitting the packet to the conference server at a cycle corresponding to the combined time.

10. The non-transitory computer-readable medium according to claim 9, wherein

the first generation operation comprises:

a third generation operation sequentially generating unit sound data by sequentially compressing the sampling data for the predetermined period of time in the order of storage of the sampling data in the first storage portion, the unit sound data being obtained by compressing the sampling data for a predetermined period of time equal to or less than the combined time; and

a storage operation storing the unit sound data generated by the third generation operation in the second storage portion, wherein

the instructions, when executed by the processor of the communication device, perform the processes further comprising a judgment operation judging whether the unit sound data for a period of time equal to or greater than the combined time is stored in a second storage portion, and wherein

the second generation operation generates a packet including the unit sound data for the combined time in response to the judgment operation judging that the unit sound data for the period of time equal to or greater than the combined time is stored in the second storage portion.

11. A communication device capable of communication with a plurality of counterpart devices via a network, the communication device comprising:

a processor; and

a memory storing computer-readable instructions, the instructions, when executed by the processor, performing processes comprising;

a first judgment operation judging whether sampling data of sound for a period of time equal to or greater than a predetermined period of time is stored in a first storage portion;

a first generation operation sequentially generating, in response to the first judgment operation judging that the sampling data of sound for the first period of time equal to or greater than the predetermined period of time is stored in the first storage portion, unit sound data by sequentially compressing the sampling data in the first storage portion for the predetermined period of time in an order of storage in the first storage portion;

a storage operation storing the unit sound data in a second storage portion;

a determination operation determining whether a communication state of the network is one of a first state and a second state different from the first state, based on at least one of transmission data that is transmitted to the network and reception data received from the network;

a setting operation setting a combined time corresponding to a length of time of sound in sound data included in a single packet, the combined time being one of;

a first period of time when the determination operation determines that the communication state is the first state; and

a second period of time longer than the first period of time when the determination operation determines that the communication state is the second state;

a second judgment operation judging whether the unit sound data for a period of time equal to or greater than the combined time is stored in the second storage portion;

a second generation operation generating the packet including the unit sound data for the combined time in response to the second judgment operation judging that the unit sound data for the period of time equal to or greater than the combined time is stored in the second storage portion; and

a transmission operation transmitting, to at least one counterpart device at a cycle corresponding to the combined time, the packet generated by the second generation operation.

12. The communication device according to claim 11, wherein the instructions, when executed by the processor, perform the processes further comprising a measurement operation measuring first jitter, the first jitter indicating a degree of variation in at least one of a first delay time and a second delay time, the first delay time being from when the transmission data is transmitted to a conference server to when the transmission data is received by the conference server, and a second delay time being from when the reception data is transmitted by the conference server to when the reception data is received by the communication device, the conference server connected to the network and conducting a teleconference among the communication device and a plurality of the counterpart devices, and wherein

the determination operation determines that the communication state is the first state when the first jitter is a first value, and determines that the communication state is the second state when the first jitter is a second value greater than the first value.

13. The communication device according to claim 12, wherein the instructions, when executed by the processor, perform the processes further comprising:

an acquisition operation acquiring a plurality of second jitter indicating a degree of variation in at least one of a plurality of third delay times and a plurality of fourth delay times, each of the third delay times being from when each of the plurality of counterpart devices transmits the transmission data to the conference server to when the conference server receives the transmission data, and each of the fourth delay times being from when the reception data is transmitted by the conference server to when the reception data is received by each of the plurality of counterpart devices, and wherein

the determination operation determines that the communication state is the first state when a largest jitter, from among the first jitter and the second jitter, is a first value, and determines that the communication state is the second state when the largest jitter is a second value that is larger than the first value.

14. The communication device according to claim 13, wherein

the largest jitter is selected from among a plurality of combined jitter, each of the combined jitter being defined by combining the first jitter and one of the plurality of the second jitter.

15. The communication device according to claim 11, wherein the instructions, when executed by the processor, perform the processes further comprising a third judgment operation judging whether document data is being transmitted to at least one of the counterpart devices;

and wherein

the determination operation determines that the communication state is the first state when it is judged by the third judgment operation that the shared document data is not being transmitted, and determines that the communication state is the second state when it is judged by the third judgment operation that the shared document data is being transmitted.

16. The communication device according to claim 11, wherein the instructions, when executed by the processor, perform the processes further comprising a third judgment operation judging whether intra-frame compressed image data is being transmitted to at least one of the counterpart devices in a teleconference, and wherein

the determination operation determines that the communication state is the first state in response to the third judgment operation judging that the intra-frame compressed image data is not being transmitted, and determines that the communication state is the second state in response to the third judgment operation judging that the intra-frame compressed image data is being transmitted.

17. The communication device according to claim 11, wherein

the first generation operation generates the unit sound data at a first cycle, and wherein

the transmission operation transmits the packet at one of a plurality of second cycles that are each an integral multiple of the first cycle.

18. The communication device according to claim 11, wherein the instructions, when executed by the processor of the communication device, perform the processes further comprising a third judgment operation judging whether the communication state has changed, wherein

the determination operation determines that the communication state is one of the first state and the second state in response to the third judgment operation judging that the communication state has changed.