Interaction method between pieces of equipment and near-to-eye equipment

• US 10,114,457 B2
• Filed: 06/16/2016
• Issued: 10/30/2018
• Est. Priority Date: 06/17/2015
• Status: Active Grant

• Current Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Original Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Inventors: Wei, Na, Du, Lin
• Primary Examiner(s): Balaoing, Ariel
• Application Number:
  US15/184,995
• Publication Number:
  US 20160370857A1
• Time in Patent Office: 866 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

An interaction method between pieces of equipment and near-to-eye equipment is provided. A method comprises: obtaining second motion information of user eyes by near-to-eye equipment, obtaining first motion information of user equipment; and executing an interaction operation with the user equipment in response to the first motion information matching with the second motion information. A natural, portable and safe interaction method is provided between pieces of equipment. An interaction between the near-to-eye equipment and one or more pieces of user equipment is enhanced so that the user wants to interact in a case that multiple pieces of user equipment exist in a view of the user eyes.

Claims

1. A method, comprising:

obtaining, by a near-to-eye equipment comprising a processor, second motion information of an eye of a user associated with a user identity, wherein the second motion information corresponds to a motion of an object gazed at by the eye, and wherein the near-to-eye equipment is worn proximate to the eye of the user;

obtaining, by the near-to-eye equipment, first motion information of a user equipment corresponding to motion of the user equipment; and

executing, by the near-to-eye equipment, an interaction operation with the user equipment in response to determining that the user equipment is the object gazed at by the eye based on the first motion information being determined to match the second motion information.

2. The method of claim 1, wherein the first motion information comprises first motion feature information of the user equipment, and

wherein the second motion information comprises second motion feature information of the eye of the user.

3. The method of claim 2, wherein the first motion feature information comprises inertia sensing feature information of the user equipment.

4. The method of claim 2, wherein the second motion feature information comprises eye motion feature information of the eye and head motion feature information associated with the user identity.

5. The method of claim 2, wherein the second motion feature information comprises motion feature information of a gazing point of the eye associated with the user identity.

6. The method of claim 2, wherein the first motion information being determined to match the second motion information comprises a first motion feature corresponding to the first motion feature information being determined to match with the second motion feature corresponding to the second motion feature information.

7. The method of claim 6, wherein the first motion information further comprises first timestamp information corresponding to the first motion feature information, and

wherein the second motion information further comprises second timestamp information corresponding to the second motion feature information.

8. The method of claim 7, wherein the first motion information being determined to match the second motion information comprises:

according to the first timestamp information and the second timestamp information, a first time corresponding to the first motion feature substantially coincides with a second time corresponding to the second motion feature.

9. The method of claim 1, wherein an interaction operation with the user equipment comprises:

an associating operation with the user equipment.

10. The method of claim 1, wherein the interaction operation with the user equipment comprises:

an associating operation between the user equipment and another piece of user equipment, and

wherein the other piece of user equipment and the user equipment are associated.

11. The method of claim 1, wherein the interaction operation with the near-to-eye equipment comprises:

an authorization authenticating operation on the near-to-eye equipment.

21. The near-to-eye equipment of claim 1, wherein the executing module comprises:

an authorization authenticating unit configured to perform an authorization authenticating operation on the user equipment.

12. A near-to-eye equipment, comprising:

a memory that stores executable modules; and

a processor, coupled to the memory, that executes or facilitates execution of the executable modules, the executable modules comprising;

a first information obtaining module configured to obtain first motion information corresponding to motion of a user equipment;

a second information obtaining module configured to obtain second motion information corresponding to motion of an object that is viewed by at least one eye of a user associated with a user identity, wherein the second motion information is captured by the near-to-eye equipment when it is worn by the user near the at least one eye of the user; and

an executing module configured to execute an interaction operation with the user equipment that facilitates determining that the user equipment is the object in response to the first motion information matching the second motion information.

13. The near-to-eye equipment of claim 12, wherein the executable modules further comprise:

a match determining module configured to determine whether the first motion information has matched the second motion information.

14. The near-to-eye equipment of claim 13, wherein:

the first motion information comprises first motion feature information of the user equipment; and

the second motion information comprises second motion feature information of the at least one eye of the user, wherein the match determining module comprises;

a first match determining unit configured to determine whether the at least one first motion feature corresponding to the first motion feature information and the at least one second motion feature corresponding to the second motion feature information are matched.

15. The near-to-eye equipment of claim 14, wherein the first motion feature information comprises:

inertia sensing feature information of the user equipment.

16. The near-to-eye equipment of claim 14, wherein the second motion feature information comprises:

eye motion feature information of the at least one eye of the user and head motion feature information of the user.

17. The near-to-eye equipment of claim 14, wherein the second motion feature information comprises:

motion feature information of a gazing point of the at least one eye of the user.

18. The near-to-eye equipment of claim 14, wherein

the first motion information further comprises first timestamp information corresponding to the first motion feature information;

and

the second motion information further comprises second timestamp information corresponding to the second motion feature information, wherein the match determining module further comprises;

a second match determining unit configured to, according to the first timestamp information and the second timestamp information, determine whether at least one first time corresponding to each first motion feature represented in the first motion feature information is proximate in time with at least one second time corresponding to each matched second motion feature in the second motion feature information.

19. The near-to-eye equipment of claim 12, wherein the executing module comprises:

a first associating unit configured to execute an associating operation with the user equipment.

20. The near-to-eye equipment of claim 12, wherein the executing module comprises:

a second executing module configured to execute an associating operation between the user equipment and other pieces of user equipment, wherein the other pieces of user equipment and the user equipment are associated.

22. A near-to-eye equipment, comprising:

a memory configured to store a command;

a processor configured to execute the command of the memory, wherein the command enables the processor to execute operations, comprising;

obtaining second motion information corresponding to motion of an object focused on by an eye of a user, wherein the second motion information is generated by the near-to-eye equipment when worn by the user near to the eye of the user;

obtaining first motion information corresponding to motion of a user equipment; and

executing an interaction operation with the user equipment in response to determining, based on the first motion information matching with the second motion information, that the user equipment is the object focused on by the eye of the user.