Method and system for video call using two-way communication of visual or auditory effect

• US 10,182,095 B2
• Filed: 10/02/2017
• Issued: 01/15/2019
• Est. Priority Date: 12/15/2015
• Status: Active Grant

• Current Assignee: LY Corp. (A Holdings Corp.), Z Intermediate Global Corporation
• Original Assignee: LINE Corporation (A Holdings Corp.)
• Inventors: Kim, Keum Ryong
• Primary Examiner(s): Nguyen, Joseph J
• Application Number:
  US15/722,304
• Publication Number:
  US 20180027042A1
• Time in Patent Office: 470 Days
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A video call method and system may use a two-way transmission of a visual effect or an auditory effect. A server may manage and store content that includes visual information or auditory information as an effect to apply to a video call in association with an effect identifier. A server may receive, during the video call, an effect identifier and may transmit the visual information or audio information associated with the effect identifier to a reception-side electronic device together with a data packet for the video call.

Claims

1. A video call method implemented by a computer comprising:

managing contents including visual information or auditory information;

determining contents for applying to a video call among the managed contents;

changing at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call and the determined contents; and

transmitting the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call, wherein

the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call according to the changed parameter

wherein the transmission type is one of a first transmission type for synthesizing the visual information with the video included in the data packet and a second transmission type for transmitting the visual information separate from the video included the data packet to be overlaid on the video included the data packet, and

wherein the changing at least one parameter of the transmission type changes the transmission type in accordance with the network traffic to one of the first transmission type and the second transmission type.

2. The method of claim 1, wherein the determining contents determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the data packet, and determines contents based on the determined information.

3. The method of claim 1, wherein the determining contents determines contents by using user facial feature information acquired by analyzing a video included in the data packet.

4. The method of claim 1, wherein the determining contents determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

5. The method of claim 1, wherein the determining contents determines contents by using user body information measured at and transmitted from a sensor.

6. The method of claim 1, wherein the determining contents determines contents by using at least one of state information set to a conversation application and a conversation log stored in the conversation application.

7. The method of claim 1, wherein the transmitting in association with the data packet transmits the determined contents at the determined data transmission rate in order to synchronize an application time of the auditory information with respect to a voice signal included in the data packet.

8. A non-transitory computer-readable recording medium storing computer readable instructions that, when executed by at least one processor in a computer, causes the at least one processor to perform a video call method, the call method comprising:

managing contents including visual information or auditory information;

determining contents for applying to a video call among the managed contents;

changing at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call and the determined contents; and

transmitting the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call, wherein

the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call according to the changed parameter

wherein the transmission type is one of a first transmission type for synthesizing the visual information with the video included in the data packet and a second transmission type for transmitting the visual information separate from the video included the data packet to be overlaid on the video included the data packet, and

wherein the changing at least one parameter of the transmission type changes the transmission type in accordance with the network traffic to one of the first transmission type and the second transmission type.

9. The non-transitory computer-readable recording medium of claim 8, wherein the determining contents determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the data packet, and determines contents based on the determined information.

10. The non-transitory computer-readable recording medium of claim 8, wherein the determining contents determines contents by using user facial feature information acquired by analyzing a video included in the data packet.

11. The non-transitory computer-readable recording medium of claim 8, wherein the determining contents determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

12. The non-transitory computer-readable recording medium of claim 8, wherein the determining contents determines contents by using user body information measured at and transmitted from a sensor.

13. The non-transitory computer-readable recording medium of claim 8, the determining contents determines contents by using at least one of state information set to a conversation application and a conversation log stored in the conversation application.

14. A video call system implemented by a computer comprises:

at least one processor configured to execute computer-readable instructions on the computer,

wherein the at least one processor manages contents including visual information or auditory information,

determines contents for applying to a video call among the managed contents,

changes at least one parameter of a transmission type of visual information included in the determined contents and a data transmission rate of auditory information included in the determined contents based on network traffic related to transmission of data packet for the video call and the determined contents; and

transmits the determined contents or an identifier corresponding to the determined contents in association with a data packet for the video call, wherein

the transmitting in association with the data packet for the video call transmits the determined contents in accordance with the data packet for the video call according to the changed parameter

wherein the transmission type is one of a first transmission type for synthesizing the visual information with the video included in the data packet and a second transmission type for transmitting the visual information separate from the video included the data packet to be overlaid on the video included the data packet, and

wherein the changing at least one parameter of the transmission type changes the transmission type in accordance with the network traffic to one of the first transmission type and the second transmission type.

15. The system of claim 14, wherein the at least one processor, for determining the contents, determines information about at least one of a gender and an emotional state by analyzing at least one of a voice formant, a voice pitch, and a voice intensity included in the date packet, and determines contents based on the determined information.

16. The system of claim 14, wherein the at least one processor, for determining the contents, determines contents corresponding to a location and a time zone where the contents are to be determined from accumulated information about a location and a time zone in which the managed contents are selected by users of a voice call.

17. The system of claim 14, wherein the at least one processor, for determining the contents, determines contents by using at least one of user body information measured at and transmitted from a sensor, facial feature information acquired by analyzing a video included in the data packet, state information set to a conversation application, and a conversation log stored in the conversation application.