Interaction method between pieces of equipment and user equipment

• US 9,990,047 B2
• Filed: 06/16/2016
• Issued: 06/05/2018
• Est. Priority Date: 06/17/2015
• Status: Active Grant

• Current Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Original Assignee: Beijing Zhigu RUI TUO Tech Company Limited
• Inventors: Wei, Na, Du, Lin
• Primary Examiner(s): Balaoing, Ariel
• Application Number:
  US15/184,999
• Publication Number:
  US 20160370868A1
• Time in Patent Office: 719 Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

An interaction method between pieces of equipment and user equipment is disclosed. A method comprises: obtaining, by a piece of user equipment, first motion information of the user equipment, obtaining, by the user equipment, second motion information of at least one eye of a user from a piece of near-to-eye equipment, and executing, by the user equipment, an interaction operation with the near-to-eye equipment in response to the first motion information matching with the second motion information. A natural, portable and safe interaction method is provided between pieces of equipment. Interaction between the near-to-eye equipment and one or more pieces of user equipment is enhances so that the user wants to interact in a case that multiple pieces of user equipment exist in a view of the at least one eye of the user.

Claims

1. A method, comprising:

obtaining, by a user equipment comprising a processor, first motion information of the user equipment;

obtaining, by the user equipment, second motion information of an eye associated with a user identity from a near-to-eye equipment; and

executing, by the user equipment, an interaction operation with the near-to-eye equipment in response to the first motion information being determined to match the second motion information, wherein the first motion information being determined to match the second motion information is based on an actual motion of the user equipment and a determined motion for an object on which the eye is focused in a manner that is determined to be consistent.

2. The method of claim 1, wherein:

the first motion information comprises first motion feature information of the user equipment, and

the second motion information comprises second motion feature information of the eye associated with the user identity.

3. The method of claim 2, wherein the first motion feature information comprises inertia sensing feature information of the user equipment.

4. The method of claim 2, wherein the second motion feature information comprises eye motion feature information of the eye associated with the user identity, and head motion feature information associated with the user identity.

5. The method of claim 2, wherein the second motion feature information comprises motion feature information of a gazing point of the eye associated with the user identity.

6. The method of claim 2, wherein the first motion information matching the second motion information comprises first motion feature corresponding to the first motion feature information matches the second motion feature corresponding to the second motion feature information.

7. The method of claim 6, wherein:

the first motion information further comprises first timestamp information corresponding to the first motion feature information, and

the second motion information further comprises second timestamp information corresponding to the second motion feature information.

8. The method of claim 7, wherein the first motion information matching the second motion information comprises, according to the first timestamp information and the second timestamp information, a first time corresponding to the first motion feature substantially coincides with a second time corresponding to the second motion feature.

9. The method of claim 1, wherein an interaction operation with the near-to-eye equipment comprises an associating operation with the near-to-eye equipment.

10. The method of claim 1, wherein the interaction operation with the near-to-eye equipment comprises an authorization authenticating operation on the near-to-eye equipment.

11. A user equipment, comprising:

a memory that stores executable modules; and

a processor, coupled to the memory, that executes or facilitates execution of the executable modules, the executable modules comprising;

a first information obtaining module configured to obtain first motion information of the user equipment;

a second information obtaining module configured to obtain second motion information of at least one eye of a user from a piece of near-to-eye equipment; and

an executing module configured to execute an interaction operation with the near-to-eye equipment in response to the first motion information matching with the second motion information, wherein the first motion information matching with the second motion information is based on a motion of the user equipment and a determined motion for an object that is at a focus of the at least one eye being determined to be consistent.

12. The user equipment of claim 11, wherein the executable modules further comprise a match determining module configured to determine whether the first motion information is matched with the second motion information.

13. The user equipment of claim 12, wherein:

the first motion information comprises first motion feature information of the user equipment,

the second motion information comprises second motion feature information of the at least one eye of the user, and

the match determining module comprises;

a first match determining unit configured to determine whether the at least one first motion feature corresponding to the first motion feature information and the at least one second motion feature corresponding to the second motion feature information are matched.

14. The user equipment of claim 13, wherein the first motion feature information comprises inertia sensing feature information of the user equipment.

15. The user equipment of claim 13, wherein the second motion feature information comprises eye motion feature information of the at least one eye of the user and head motion feature information of the user.

16. The user equipment of claim 13, wherein the second motion feature information comprises motion feature information of a gazing point of the at least one eye of the user.

17. The user equipment of claim 13, wherein:

the first motion information further comprises first timestamp information corresponding to the first motion feature information,

the second motion information further comprises second timestamp information corresponding to the second motion feature information, and

the match determining module further comprises a second match determining unit configured to, according to the first timestamp information and the second timestamp information, determine whether at least one first time corresponding to each first motion feature in the at least one first motion feature is essentially coincided with at least one second time corresponding to each matched second motion feature in the at least one second feature.

18. The user equipment of claim 11, wherein the executing module comprises an associating unit configured to execute the associating operation with the near-to-eye equipment.

19. The user equipment of claim 11, wherein the executing module comprises an authorization authenticating unit configured to perform an authorization authenticating operation on the near-to-eye equipment.

20. A user equipment, comprising:

a memory configured to store a command;

a processor configured to execute the command of the memory, wherein the command enables the processor to execute operations, comprising;

obtaining first motion information of the user equipment;

obtaining second motion information of at least one eye of a user from a piece of near-to-eye equipment; and

executing an interaction operation with the near-to-eye equipment in response to the first motion information being determined to match the second motion information, wherein the first motion information being determined to match the second motion information is that the motion of the user equipment corresponding to the first motion information and the motion of a gazed object of the at least one eye corresponding to the second motion information are consistent.