Smart electronic device for multi-user environment

• US 10,623,198 B2
• Filed: 02/16/2017
• Issued: 04/14/2020
• Est. Priority Date: 08/11/2016
• Status: Active Grant

• Current Assignee: Xiamen Eco Lighting Co. Ltd.
• Original Assignee: Xiamen Eco Lighting Co. Ltd.
• Inventors: Lin, Wuwei, Ding, Yuchun, Liu, Danqing
• Primary Examiner(s): Harvey, David E
• Application Number:
  US15/435,284
• Publication Number:
  US 20180048479A1
• Time in Patent Office: 1,153 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G08G 1/123 indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, tramstransmission of navigation instructions to vehicles G08G1/0968
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4131 home appliance, e.g. lighting, air conditioning system, metering devices home automation data switching networks exchanging configuration information on appliance services H04L12/2807
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4415 using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

A smart electronic device is provided for a multi-user environment to meet more convenient life requirements of a plurality of users. The smart electronic device has a camera, a microphone, a processing circuit, a network interface and a projector. The processing circuit loads a user'"'"'s image and determines an identity of the user appearing before the camera based on the user'"'"'s image. The processing circuit also analyzes a gesture of the user fetched by the camera or a voice message fetched by the microphone for transforming into a corresponding operating command. The projector displays a frame generated in correspondence to the operating command.

Claims

1. A smart electronic device for a multi-user environment to meet more convenient life requirements of a plurality of users, comprising:

a housing, having a base for disposition on a surface;

a camera, disposed at a specific location on the housing and configured to fetch an image of a user appearing before the camera;

a microphone, disposed at a specific position on the housing and configured to fetch a voice message issued by the user;

a processing circuit, installed on the housing, connected to the camera, configured to thereby load the image of the user for determining an identity of the user appearing before the camera, and configured to analyze a gesture of the user fetched via the camera or the voice message fetched via the microphone for transforming into a corresponding operating command;

a network interface installed on the housing, connected to the processing circuit for enabling the processing circuit to communicate with a cooperative device and an external server, and transmit cooperative operation requirements to an external server via the network interface, wherein the cooperative device is disposed at different locations of the multiple-user environment, and wherein the processing circuit and the cooperative device are configured to operate cooperatively at different positions of the multi-user environment via the network interface for providing inter-user applications to the plurality of users; and

a projector, installed on the housing, connected to the processing circuit, and configured to display a frame generated in correspondence to the operating command,

wherein the at least one cooperative device is plural and comprises a camera, and the processing circuit is configured to integrate video information collected by the camera of the smart electronic device and the camera of each of the plural cooperative devices via the network interface for integrally determining a current condition of the multi-user environment to combine the collective information into a single stream.

2. The smart electronic device of claim 1, wherein when the processing circuit displays a video, the processing circuit is configured to fast forward, play, or pause the frame displayed via the projector according to the operating command transformed from the fetched gesture of the user.

3. The smart electronic device of claim 1, the processing circuit is configured to determine the identity of the user according to the fetched voice message for determining whether to proceed operations based on the identity of the user.

4. The smart electronic device of claim 1, wherein the processing circuit is configured to determine the identity of the user according to the fetched voice message or the fetched image and thereby configured to display information corresponding to the user.

5. The smart electronic device of claim 1, wherein if the processing circuit finds that the plurality of users appear in a proximity of the smart electronic device, the processing circuit is configured to determine whether to display information corresponding to one of the plurality of users according to a preset rule.

6. The smart electronic device of claim 1, wherein the smart electronic device is configured to register at least one external server via the network interface according to the determined identity of the user and pre-stored register information, configured to integrate at least one information to the user having the determined identity, and configured to display to the user having the determined identity, wherein the at least one information is transmitted from the at least one external server.

7. The smart electronic device of claim 6, wherein the at least one information comprises a purchase information that enables the user having the determined identity to directly order for purchasing.

8. The smart electronic device of claim 7, wherein the user having the determined identity issues the voice message via the microphone to directly order for purchasing.

9. The smart electronic device of claim 7, wherein the purchase information comprises a multimedia information provided via the projector to the user having the determined identity for reference.

10. The smart electronic device of claim 1, wherein the processing circuit is configured to connect to an external server via the network interface for retrieving a time information that indicate an arrival time when a public transportation vehicle arriving a station, and configured to calculate a proper time based on the retrieved time information and a moving time interval that the user takes to arrive the station for reminding the user at the calculated proper time of starting off to the station for taking the public transportation vehicle.

11. The smart electronic device of claim 1, wherein the processing circuit is configured to connect to an external server via the network interface for retrieving a time information that indicates an arrival time of a rent vehicle, and configured to calculate a proper time based on the retrieved time information and a moving time interval that the user takes to arrive the station for reminding the user at the calculated proper time of starting off to the station for taking the rent vehicle.

12. The smart electronic device of claim 1, wherein one of the plural cooperative devices comprises a feeding device, and the processing circuit is configured to control the plural cooperative devices via the network interface for feeding a pet via the feeding device.

13. The smart electronic device of claim 1, wherein the processing circuit is configured to automatically edit frames fetched by the camera of the smart electronic device and frames fetched by the cameras of the cooperative devices for generating at least one subscrible video stream.

14. The smart electronic device of claim 13, wherein the processing circuit is configured to determine a current location of a certain user in the multi-user environment according to the at least one integrated video stream.

15. The smart electronic device of claim 14, wherein the processing circuit is configured to transmit a multimedia information to one of the plural cooperative devices corresponding to a location of a certain user for displaying.

16. The smart electronic device of claim 1, wherein the processing circuit is configured to transmit a scheduled task to one of the plural cooperative devices for further processing when electricity of the smart electronic device is lower than a predetermined value.

17. The smart electronic device of claim 1 further comprises a vibration sensor, wherein the processing circuit is configured to transform vibration to a corresponding operating command, wherein the vibration is transmitted from the base to the vibration sensor.

18. The smart electronic device of claim 17, wherein the operating command is used for an alarm clock application.

19. The smart electronic device of claim 1, wherein the processing circuit is configured to analyze a voice fetched by the microphone or an image fetched by the camera for determining if a predetermined condition occurs, and is configured to issue a notice to at least one external device via the network interface when the predetermined condition occurs.

20. The smart electronic device of claim 19, wherein the predetermined condition comprises a situation that a user needs help.

21. The smart electronic device of claim 20, wherein the situation comprises a call from an aged person, a call from a patient, a baby'"'"'s kicking on a quilt, or a crying from the baby.

22. The smart electronic device of claim 20, wherein the issued notice comprises the video recorded by or the frame fetched by the camera.

23. The smart electronic device of claim 21, wherein the external device is another one cooperative device programmed to assist users in its proximity.

24. The smart electronic device of claim 1, wherein the processing circuit is configured to receive a sport information corresponding to a certain user transmitted by at least one smart sport device, and is configured to provide a meal recommendation information corresponding to the certain user when the certain user meals.

25. The smart electronic device of claim 1, further comprising a human proximity sensor, wherein when nobody is active in the proximity of the smart electronic device, the processing circuit is configured to enter a power saving mode.

26. The smart electronic device of claim 1, further comprising a human proximity sensor, wherein when the human proximity sensor senses human activities in the proximity of the smart electronic device, the processing circuit is configured to be automatically activated to start functioning.

27. The smart electronic device of claim 1, wherein the base is disposed on a wireless charging base for wireless charging, and the base is detachable from the wireless charging base.

28. The smart electronic device of claim 1, further comprising a luminance device disposed on the housing, wherein the luminance device is configured to provide corresponding luminance effects controlled by the processing circuit.