Method, apparatus, and system for controlling smart home environment using LED lighting device

• US 9,892,605 B2
• Filed: 05/20/2015
• Issued: 02/13/2018
• Est. Priority Date: 11/10/2014
• Status: Active Grant

• Current Assignee: Sengled Optoelectronics Co., Ltd. (SengLED USA, Inc.)
• Original Assignee: Sengled Optoelectronics Co., Ltd. (SengLED USA, Inc.)
• Inventors: Zheng, Jianbing, Sun, Chaoqun, Shen, Jinxiang
• Primary Examiner(s): Yacob, Sisay
• Application Number:
  US15/026,451
• Publication Number:
  US 20160321891A1
• Time in Patent Office: 1,000 Days
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19636 pertaining to the camera
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19684 Portable terminal, e.g. mobile phone, used for viewing video remotely
• CPC Class Codes: G08B 25/08 using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: G08B 25/10 using wireless transmission systems G08B25/009 takes precedence
• CPC Class Codes: H04L 12/2825 Reporting to a device located outside the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; telephonic communication systems adapted for combination with telemetering systems H04M11/002
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04M 1/72415 for remote control of appliances

Abstract

The present disclosure provides a smart home control system including at least one LED lighting device, a smart home control server and at least one smart terminal. The LED lighting device includes an LED light-emitting module, a power supply module, a video acquisition module, a processing module and a communication module. The video acquisition module may be configured to collect video data within a camera detection range, and send the video data to the processing module. The processing module controls the communication module to send the video data to the smart home control server. The smart home control server parses and recognizes the video data to detect behavioral information, generates control instructions according to the behavioral information, and sends the control instructions to the smart terminal. The system consistent with the present disclosure enables timely detection and prevention of illegal activities and/or unsafe behaviors, as well as recognition and execution of specified user instructions.

Claims

1. An LED lighting device, comprising an LED light-emitting module, a power supply module, a video acquisition module, a communication module and a processing module;

wherein;

the power supply module is electrically connected to the LED light-emitting module, the video acquisition module, the communication module and the processing module, respectively;

the processing module is electrically connected to the video acquisition module and the communication module;

the video acquisition module is configured to collect video data within a camera detection range, and send the video data to the processing module;

the processing module is configured to control the communication module to send the video data to a smart home control server; and

the smart home control server is configured to parse and process the video data to detect behavioral information, generate control instructions according to the behavioral information, and send the control instructions to a smart terminal.

2. The LED lighting device according to claim 1, further comprising:

a light sensor configured to detect light intensity in a surrounding area of the LED lighting device and send the light intensity data to the processing module; and

a supplemental infrared light module configured to provide supplemental light for the video acquisition module;

wherein;

the infrared supplemental light module is electrically connected to the power supply module and the processing module;

the light sensor is electrically connected to the power supply module and the processing module; and

the processing module is further configured to control an on/off status of the infrared supplemental light module and intensity of the supplemental light provided by the infrared supplemental light module.

3. The LED lighting device according to claim 2, further comprising:

an audio acquisition module configured to collect audio data and send the audio data to the processing module;

wherein;

the audio acquisition module is electrically connected to the power supply module and the processing module;

the processing module is further configured to control the communication module to send the audio data to the smart home control server; and

the smart home control server is configured to parse and process the video data and the audio data to detect the behavioral information.

4. The LED lighting device according to claim 3, wherein:

the communication module is further configured to receive configuration information from the smart terminal and send the configuration information to the processing module;

the configuration information includes operation parameters of at least one of the LED light-emitting module, the video acquisition module, the light sensor, and the audio acquisition module; and

the processing module is further configured to control an operational state of a corresponding module according to the configuration information.

5. The LED lighting device according to claim 1, wherein:

the processing module is electrically connected to the LED light-emitting module;

the communication module is further configured to receive control instructions from the smart home control server and send the control instructions to the processing module;

the control instructions are used to notify the LED light-emitting module to adjust a lighting brightness level or flash; and

the processing module is further configured to control an operational state of the LED light-emitting module according to the control instructions.

6. The LED lighting device according to claim 1, wherein the processing module is further configured to:

when there is no change in the video data collected by the video acquisition module for a preset time duration, stop the communication module from transmitting the video data to the smart home control server; and

when the video data has changed, instruct the communication module to send the video data to the smart home control server.

7. The LED lighting device according to claim 1, wherein the power supply module further includes:

a step-down circuit configured to provide different voltages to corresponding modules of the LED lighting device; and

a rectifier circuit configured to output a DC voltage to the step-down circuit;

wherein;

an input of the rectifier circuit is electrically connected to an external AC power supply;

an output of the rectifier circuit is electrically connected to an input of the step-down circuit;

a first voltage output of the step-down circuit is electrically connected to the LED light-emitting module; and

a second voltage output of the step-down circuit is electrically connected to the processing module, the video acquisition module and the communication module.

8. The LED lighting device according claim 1, wherein:

the video acquisition module further includes a camera having auto-focus capabilities and an angle-adjustment structure;

the camera is connected to the angle-adjustment structure;

the camera and the angle-adjustment structure are electrically connected to the processing module; and

the angle-adjustment structure is configured to rotate and turn the camera to adjust shooting angles in response to receiving control instructions from the processing module.

9. The LED lighting device according to claim 1, wherein the communication module is a wireless communication module.

10. A smart home control system using at least one LED lighting device, comprising:

at least one LED lighting device configured to include an LED light-emitting module, a power supply module, a video acquisition module, a processing module and a communication module;

a smart home control server; and

at least one smart terminal;

wherein;

the video acquisition module is configured to collect video data within a camera detection range, and send the video data to the processing module of the LED lighting device;

the processing module is configured to control the communication module to send the video data to the smart home control server;

the smart home control server is configured to parse and process the video data to detect behavioral information, generate control instructions according to the behavioral information, and send the control instructions to the smart terminal; and

the smart terminal is configured to receive the control instructions and execute the control instructions.

11. The smart home control system according to claim 10, wherein the smart home control server is further configured to:

include a memory module configured to store at least one of the video data, audio data, a behavior database, and a control instruction library; and

recognize and compare the video data and audio with data stored in the behavior database to detect matching behavioral information; and

search the control instructions according to the detected behavioral information in the behavioral instruction library.

12. The smart home control system according to claim 11, wherein:

the smart terminal is further configured to receive one or more data entries for at least one of the behavior database and the behavioral instruction library from a user, and send the data entry to the smart home control server; and

the smart home control server is further configured to update at least one of the behavior database and the behavioral instruction library according to the data entries.

13. The smart home control system according to claim 10, wherein:

the smart terminal is further configured to receive configuration information from a user, and send the configuration information to the LED lighting device;

the configuration information includes operation parameters for one or more modules of the LED lighting device, wherein the one or more modules include at least one of the LED light-emitting module, the video acquisition module, a light sensor, and an audio acquisition module; and

the processing module of the LED lighting device is further configured to control an operational state of a corresponding module according to the configuration information.

14. The smart home control system according to claim 10, wherein:

the smart terminal is one or more of the LED lighting device, a smart refrigerator, a smart air conditioner, a speaker, a smart phone, a smart watch, a tablet computer, a laptop computer and a telephone.

15. The smart home control system according to claim 10, wherein:

in response to detecting a person or an object breaking in a door or a window in the video data, the smart home control server determines the behavioral information as an intrusion, and sends control instructions to notify the smart terminal to generate alarm by at least one of sound, light, and vibration;

in response to detecting an elderly person or a child tripping or falling in the video data, the smart home control server determines the behavioral information as an unsafe activity, and sends control instructions to notify the smart terminal to generate alarm by at least one of sound, light, and vibration; and

in response to detecting a specified instructive behavior by a user, the smart home control server determines the behavioral information as an instructive behavior, and sends control instructions to notify the smart terminal to perform corresponding controls, wherein the specified instructive behavior is a hand gesture or a limb movement preset by the user.

16. A method for controlling a smart home environment using an LED lighting device, comprising:

providing at least one LED lighting device configured to include an LED light-emitting module, a power supply module, a video acquisition module, a processing module and a communication module;

collecting, by the video acquisition module of the LED lighting device, video data in a camera detection range;

sending, by the communication module of the LED lighting device, the video data to a smart home control server;

parsing and recognizing, by the smart home control server, the video data to detect behavioral information;

generating, by the smart home control server, control instructions according to the behavioral information; and

sending the control instructions to a corresponding smart terminal.

17. The method for controlling a smart home environment according to claim 16, further comprising:

collecting, by an audio acquisition module of the LED lighting device, audio data from an area surrounding the LED lighting device;

sending, by the communication module of the LED lighting device, the audio data to the smart home control server; and

parsing and recognizing, by the smart home control server, both the video data and the audio data to detect the behavioral information.

18. The method for controlling a smart home environment according to claim 16, wherein generating control instructions further includes:

providing a memory module in the smart control server to store at least one of the video data, audio data, a behavior database and a behavioral instruction library;

recognizing and comparing, by the smart home control server, the video data with data stored in the behavior to detect matching behavioral information; and

searching control instructions according to the detected behavioral information in the behavioral instruction library.

19. The method for controlling a smart home environment according to claim 18, further comprising:

receiving, by the smart terminal, one or more data entries for at least one of the behavior database and the behavioral instruction library from a user;

sending, by the smart terminal, the data entries to the smart home control server; and

updating, by the smart home control server, at least one of the behavior database and the behavioral instruction library according to the data entries.

20. The method for controlling a smart home environment according to claim 16, further comprising:

receiving, by the smart terminal, a configuration information from a user, wherein the configuration information includes operation parameters for one or more modules of the LED lighting device, and the one or more modules include at least one of the LED light-emitting module, the video acquisition module, a light sensor and an audio acquisition module;

sending, by the smart terminal, the configuration information to the LED lighting device; and

controlling, by the processing module of the LED lighting device, an operational state of a corresponding module according to the configuration information.