Method and device for controlling intelligent equipment

• US 9,894,260 B2
• Filed: 07/26/2016
• Issued: 02/13/2018
• Est. Priority Date: 11/17/2015
• Status: Active Grant

• Current Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Original Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Inventors: Liu, Huayijun, Wu, Ke, Zhang, Pengfei
• Primary Examiner(s): Pasiewicz, Daniel M
• Application Number:
  US15/219,791
• Publication Number:
  US 20170142317A1
• Time in Patent Office: 567 Days
• CPC Class Codes: A47C 21/003 Lighting, radio, telephone or the like connected to the bedstead
• CPC Class Codes: A47C 31/008 Use of remote controls
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/00381 Input by recognition or interpretation of visible user gestures manual input means, e.g. digitisers, writing tablets H04N1/00392; gesture input to computers G06F3/017; recognition algorithms G06V40/20
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A method for controlling intelligent equipment includes receiving an image acquisition request sent from an intelligent mattress. The image acquisition request contains an identifier (ID) of the intelligent mattress and is triggered when a user uses the intelligent mattress. The method further includes sending the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress, receiving eyeball information of the user and device identification information, determining a target intelligent device based on the device identification information, and controlling the target intelligent device based on the eyeball information.

Claims

1. A method for controlling intelligent equipment, comprising:

receiving an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

sending the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receiving eyeball information of the user and device identification information;

determining a target intelligent device based on the device identification information; and

controlling the target intelligent device based on the eyeball information.

2. The method according to claim 1, wherein:

the device identification information includes a sight position image obtained by the intelligent photographing device by performing image acquisition on a sight position to which a sight direction of the user points, and

determining the target intelligent device includes;

selecting, from a stored image library, a target image matching the sight position image; and

determining an intelligent device in the target image as the target intelligent device.

3. The method according to claim 1, wherein controlling the target intelligent device based on the eyeball information includes:

acquiring a corresponding control operation from a stored corresponding relationship between eyeball information and control operations based on the eyeball information; and

controlling the target intelligent device based on the acquired corresponding control operation.

4. A method for controlling intelligent equipment, comprising:

receiving an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

sending the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receiving a mattress position image and eyeball information of the user, the mattress position image being obtained by the intelligent photographing device by performing image acquisition on a position where the intelligent mattress is located;

determining a target intelligent device based on the mattress position image; and

controlling the target intelligent device based on the eyeball information.

5. The method according to claim 4, wherein determining the target intelligent device includes:

determining a sight direction of the user according to the mattress position image; and

determining the target intelligent device based on the sight direction.

6. The method according to claim 5, wherein determining the sight direction includes:

performing face recognition on the mattress position image to obtain an eye position of the user; and

performing sight recognition on an eye of the user to obtain the sight direction of the user based on the eye position.

7. The method according to claim 6, wherein performing the sight recognition on the eye of the user includes:

determining an eye pupil offset angle of an eye pupil of the user relative to a normal sight direction based on the eye position; and

determining the sight direction of the user based on the eye pupil offset angle.

8. The method according to claim 5, wherein determining the target intelligent device based on the sight direction includes:

determining a sight-horizontal angle between the sight direction and a horizontal direction and a sight-specified angle between the sight direction and a specified direction;

acquiring a corresponding intelligent device ID from a stored corresponding relationship among sight-horizontal angles, sight-specified angles, and intelligent device IDs based on the sight-horizontal angle and the sight-specified angle; and

determining an intelligent device corresponding to the acquired corresponding intelligent device ID as the target intelligent device.

9. The method according to claim 5, wherein determining the target intelligent device based on the sight direction includes:

sending the sight direction to the intelligent photographing device;

receiving a sight position image obtained by the intelligent photographing device by performing image acquisition on a sight position to which the sight direction points; and

determining the target intelligent device based on the sight position image.

10. The method according to claim 9, wherein determining the target intelligent device based on the sight position image includes:

selecting a target image matching the sight position image from a stored image library; and

determining an intelligent device in the target image as the target intelligent device.

11. The method according to claim 9, wherein determining the target intelligent device based on the sight position image includes:

recognizing, from the sight position image, a device mark of an intelligent device in the sight position image;

acquiring a corresponding intelligent device ID from a stored corresponding relationship between device marks and intelligent device IDs based on the recognized device mark; and

determining an intelligent device corresponding to the acquired corresponding intelligent device ID as the target intelligent device.

12. The method according to claim 4, wherein controlling the target intelligent device includes:

acquiring a corresponding control operation from a stored corresponding relationship between eyeball information and control operations based on the eyeball information; and

controlling the target intelligent device based on the acquired corresponding control operation.

13. A device for controlling intelligent equipment, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to;

receive an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

send the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receive eyeball information of the user and device identification information;

determine a target intelligent device based on the device identification information; and

control the target intelligent device based on the eyeball information.

14. The device according to claim 13, wherein:

the device identification information includes a sight position image obtained by the intelligent photographing device by performing image acquisition on a sight position to which a sight direction of the user points, and

the instructions further cause the processor to;

select, from a stored image library, a target image matching the sight position image; and

determine an intelligent device in the target image as the target intelligent device.

15. A device for controlling intelligent equipment, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to;

receive an image acquisition request sent from an intelligent mattress, the image acquisition request containing an identifier (ID) of the intelligent mattress and being triggered when a user uses the intelligent mattress;

send the image acquisition request to an intelligent photographing device associated with the intelligent mattress based on the ID of the intelligent mattress;

receive a mattress position image and eyeball information of the user, the mattress position image being obtained by the intelligent photographing device by performing image acquisition on a position where the intelligent mattress is located;

determine a target intelligent device based on the mattress position image; and

control the target intelligent device based on the eyeball information.

16. The device according to claim 15, wherein the instructions further cause the processor to:

determine a sight direction of the user according to the mattress position image;

determine the target intelligent device based on the sight direction; and

control the target intelligent device based on the eyeball information.