TERMINAL AND METHOD FOR BIDIRECTIONAL LIVE SHARING AND SMART MONITORING

• US 20200136846A1
• Filed: 09/15/2014
• Published: 04/30/2020
• Est. Priority Date: 06/26/2014
• Status: Active Grant

• Current Assignee: Ainemo Inc. (Beijing Baidu Netcom Science & Technology Co. Ltd.)
• Original Assignee: Ainemo Inc. (Beijing Baidu Netcom Science & Technology Co. Ltd.)
• Inventors: SONG, Chenfeng
• Granted Patent: US 11,115,227 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2320/0626 for control of overall brightness
• CPC Class Codes: G09G 2370/20 Details of the management of multiple sources of image data
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/152 Multipoint control units therefor
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The present invention discloses a terminal and method for bidirectional live sharing and smart monitoring. The terminal comprises: a camera, an audio capture unit, a display, a speaker, and a transceiver; by means of a dedicated channel, the transceiver sends, in real time and to a specific address, the video and audio captured by the camera and audio capture unit, respectively; by means of the dedicated channel, the transceiver receives the video and audio in real time from said specific address and outputs the video and audio by means of the display and the speaker; furthermore, the transceiver responds to a person or specific person or specific action or abnormal situation identified from the video and audio captured by the camera and audio capture unit, respectively; the transceiver sends notification information to said specific address in real time, the dedicated channel having been established in advance, and the terminal being used for trusted locations. In comparison with the prior art, the present invention improves user experience in real-time communications, making it more convenient and safer for the user to monitor the conditions at a specific location, or of a specific person.

Claims

1. A terminal for bi-directional live sharing and smart monitoring, comprising:

a video capture unit, an audio capture unit, a display, a speaker and a transceiver, wherein the transceiver transmits the video and the audio respectively captured by the video capture unit and the audio capture unit in real time to the specific address via the dedicated channel and receives the video and audio from the specific address in real time through the dedicated channel, then output respectively through the display and the speaker, in response to recognizing a person or a specific person, the specific action, or abnormal conditions from the video and audio respectively captured by the video capture unit and the audio capture unit, the transceiver sends notification information to the specific address in real time, wherein the dedicated channel is established in advance, each time the transceiver sending video and audio in real time to a specific address or receiving video and audio from a specific address, there is no need to re-establish the call, and the terminal is used for a trusted fixed place.

2. The terminal according to claim 1, further comprising a recorder configured to start recording video and audio in response to identifying a person or a specific person, the specific action, or abnormal conditions from the collected video and audio the collected video and audio, and stops recording in response to a person or a specific person, or a specific action, or an abnormal condition disappears, the transceiver transmits the recorded content to the specific address when the recording is stopped.

3. The terminal according to claim 1, wherein the terminal of the specific address is bound to a specific mobile terminal, wherein

in response to identifying a person or a specific person, or a specific action, or an abnormal condition from the captured video and audio, the transceiver sends notification information to a specific mobile terminal bound to the terminal of the specific address, and/or send the video and audio captured by the video capture unit and the audio capture unit in real time to a specific mobile terminal bound to the terminal of the specific address.

5. The terminal according to claim 1, wherein the notification information includes at least one of the following:

information for requesting the terminal of the specific address enhances the display brightness of the video collected by the video capture unit;

information for requesting the terminal of the specific address enhances the brightness of the identified person or specific person or the specific action or abnormal condition;

information for requesting the terminal of the specific address superimposes a specific text or picture on the display;

information for requesting the terminal of the specific address outputs a specific sound; and

information for requesting the terminal of the specific address automatically records the video and the audio including identified person or specific person or the specific action or abnormal condition respectively collected by the video capture unit and the audio capture unit sent by the transceiver.

6. The terminal according to claim 1, wherein said transceiver receives notification information from said specific address regarding to the terminal of the specific address identified a person or a specific person or a specific action or an abnormal condition.

7. The terminal according to claim 6, wherein in response to receiving the notification information, at least one of the following is performed:

enhance the brightness of displayed video received by the display;

enhance the brightness of a person or a specific person or a specific action or an abnormal condition identified by the terminal at the specific address;

superimposing a specific text or picture on the display;

the speaker outputs a specific sound; and

automatically records the video and the audio including identified person or specific person or the specific action or abnormal condition received by the transceiver in real-time.

8. The terminal of claim 1, wherein the transceiver sends a message to the specific address in response to the specific action being recognized as a departure from home.

13. The terminal according to claim 8, wherein the terminal of the specific address is bound to a specific mobile terminal, and in response to the specific action identified being that a specific person leaves home, the transceiver sends the text message and/or the voice message set by the specific person to the specific mobile terminal bound with the terminal of the specific address.

14. The terminal according to claim 1, wherein the terminal is bound to a user'"'"'s mobile terminal and in response to the transceiver receives the text and/or voice memo, recognizing a person or a specific person in the video and audio respectively collected from the video capture unit and the audio capture unit;

in response to no person or a specific person is recognized from video or audio captured by the video capture unit or the audio capture unit, forwarding the received text and/or voice message to the user'"'"'s mobile terminal bound to the terminal.

16. The terminal according to claim 1, wherein the specific address is a plurality of specific addresses.

17. The terminal according to claim 16, wherein the dedicated channel is a set of dedicated channels formed by server transfer between the terminal and the plurality of specific addresses.

24. The terminal of claim 1, wherein the abnormal conditions are identified by identifying one or more of:

dramatic changes in the video captured by the video capture unit;

audio captured by the audio capture unit above a certain threshold;

a dramatic change in audio captured by the audio capture unit (102); and

a predetermined event identified based on the video and audio respectively captured by the video capture unit and the audio capture unit, wherein a model of the predetermined event has been established in advance and a predetermined event is identified by searching for an event matched with an established model from video and audio respectively acquired based on the video capture unit and the audio capture unit.

4. (canceled)

9-12. -12. (canceled)

15. (canceled)

18-23. -23. (canceled)

25-27. -27. (canceled)

28. A method for bi-directional live sharing and smart monitoring comprising:

transmitting the collected video and audio to a specific address in real time through a dedicated channel and receiving the video and audio from the specific address in real time over the dedicated channel; and

in response to identifying a person or a specific person, or a specific action, or an abnormal condition from the collected video and audio, sending a notification information to the specific address in real time, wherein

the dedicated channel is established in advance, at each time sending video and audio in real time to a specific address or receiving video and audio from a specific address, there is no need to re-establish the call.

29. The method of claim 28, further comprising:

recording is start in response to recognizing a person or a specific person, or a specific action, or an abnormal condition from the collected video and audio, and is stop in response to a person or a specific person, or a specific action, or an abnormal condition disappears, after stop recording, sending the recorded content to the specific address.

30. The method according to claim 28, wherein a terminal of the specific address is bound to a specific mobile terminal, and the method further comprises:

in response to identifying a person or a specific person, or a specific action, or an abnormal condition from the captured video and audio, sending notification information to a specific mobile terminal bound to the terminal of the specific address, and/or sending the video and audio captured by the video capture unit and the audio capture unit in real time to a specific mobile terminal bound to the terminal of the specific address.

32. The method of claim 28, wherein the notification information includes at least one of:

information for requesting the terminal of the specific address enhances the display brightness of the collected video;

information for requesting the terminal of the specific address enhances the brightness of the identified person or specific person or the specific action or abnormal condition;

information for requesting the terminal of the specific address superimposes a specific text or picture on the display;

information for requesting the terminal of the specific address outputs a specific sound; and

information for requesting the terminal of the specific address automatically records the video and the audio including identified person or specific person or the specific action or abnormal condition sent to the specific address.

33. The method of claim 28, further comprising:

receiving notification information from the specific address regarding the person or specific person identified by the terminal at the specific address, or a specific action, or an abnormal condition.

34. The method of claim 33, further comprising:

in response to receiving the notification information, at least one of the following is performed;

enhance the brightness of displayed video;

enhance the brightness of a person or a specific person or a specific action or an abnormal condition identified by the terminal at the specific address;

superimposing a specific text or picture on the display;

outputs a specific sound; and

automatically records the received video and the audio including identified person or specific person or the specific action or abnormal condition.

37. The method of claim 28, wherein transmitting the message set by the specific person to the specific address in response to the specific action recognized being that a specific person leaves the home.

38. The method according to claim 37, wherein the message set by the specific person is a text message and/or a voice message, wherein the text message is input by the specific person on an interface of the display, the voice message is recorded by the specific person through an audio capture unit.

31. (canceled)

35-36. -36. (canceled)

39-42. -42. (canceled)