Method and apparatus for touch responding of wearable device as well as wearable device

• US 10,185,433 B2
• Filed: 02/14/2016
• Issued: 01/22/2019
• Est. Priority Date: 09/10/2015
• Status: Active Grant

• Current Assignee: BOE Technology Group Co., Ltd.
• Original Assignee: BOE Technology Group Co., Ltd.
• Inventors: Lv, Xuewen
• Primary Examiner(s): Pardo, Thuy
• Application Number:
  US15/325,057
• Publication Number:
  US 20170205939A1
• Time in Patent Office: 1,073 Days
• Field of Search: 345156, 345158, 345168, 345173, 348169, 713168
• CPC Class Codes: G04G 21/08 Touch switches specially adapted for time-pieces
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The present disclosure relates to a method and apparatus for touch responding of a wearable device, and the wearable device. The method for touch responding of the wearable device comprises: acquiring position information of a target fingertip collected by binocular recognition means in a set touch action occurrence area; determining a mapping point mapped on a screen of the wearable device for the target fingertip based on the position information of the target fingertip; and displaying a cursor at the mapping point on the screen of the wearable device. The wearable device according to the present disclosure feeds back effect of touch operations to the user in real time, and thus improves touch accuracy of the wearable device.

Claims

1. A method for touch responding of a wearable device, comprising:

acquiring position information of a target fingertip collected by binocular recognition means in a set touch action occurrence area;

determining a mapping point mapped on the screen of the wearable device for the target fingertip based on the position information of the target fingertip and the corresponding relationship; and

identifying the mapping point on the screen of the wearable device;

wherein before said acquiring the position information of the target fingertip in the set touch action occurrence area, the method further comprises setting the touch action occurrence area by;

acquiring a target fingertip circling trajectory collected by the binocular recognition means after receiving a trigger instruction for setting the touch action occurrence area and determining a standard circling trajectory corresponding to the target fingertip circling trajectory;

determining a reference point for establishing mapping between the target fingertip and the screen of the wearable device according to the standard circling trajectory and a boundary of the screen of the wearable device; and

setting the touch action occurrence area according to the reference point, the standard circling trajectory and the boundary of the screen of the wearable device;

wherein the mapping point is determined according to the position information of the target fingertip and the reference point.

2. The method according to claim 1, wherein determining a standard circling trajectory corresponding to the target fingertip circling trajectory comprises:

performing envelop calculation for the target fingertip circling trajectory to determine a minimum envelop space that accommodates the target fingertip circling trajectory; and

determining the standard circling trajectory corresponding to the target fingertip circling trajectory according to the minimum envelop space.

3. The method according to claim 2, wherein the method further comprises:

acquiring a gesture action of the target fingertip in the set touch action occurrence area; and

performing a control operation matching with a set gesture action when the gesture action is identified as the set gesture action, and/or, enabling a cursor to display a preset variation effect matching with the set gesture action.

4. The method according to claim 1, wherein the method further comprises:

acquiring a gesture action of the target fingertip in the set touch action occurrence area; and

performing a control operation matching with a set gesture action when the gesture action is identified as the set gesture action, and/or, enabling a cursor to display a preset variation effect matching with the set gesture action.

5. The method according to claim 4, wherein the method further comprises:

stopping the touch response upon detecting that the target fingertip located in the set touch action occurrence area moves out of the touch action occurrence area for a period exceeding a preset threshold.

6. The method according to claim 1, wherein before determining a mapping point mapped on the screen of the wearable device for the target fingertip, the method further comprises:

acquiring space acceleration information of the wearable device collected by an acceleration sensor; and

modifying the position information of the target fingertip according to the space acceleration information.

7. An apparatus for touch responding of a wearable device, comprising:

a first acquisition module configured to acquire position information of a target fingertip collected by binocular recognition means in a set touch action occurrence area;

a determination module configured to determine a mapping point mapped on the screen of the wearable device for the target fingertip based on the position information of the target fingertip and the corresponding relationship;

a processing module configured to identify the mapping point on the screen of the wearable device; and

a setting module configured to set the touch action occurrence area before acquiring the position information of the target fingertip in the set touch action occurrence area by;

acquiring the target fingertip circling trajectory collected by binocular recognition means after receiving a trigger instruction for setting the touch action occurrence area and determining a standard circling trajectory corresponding to the target fingertip circling trajectory;

determining a reference point for establishing mapping between the target fingertip and the screen of the wearable device according to the standard circling trajectory and a boundary of the screen of the wearable device; and

setting the touch action occurrence area according to the reference point, the standard circling trajectory and the boundary of the screen of the wearable device; and

the setting module is further configured to determine the mapping point according to the position information of the target fingertip and the reference point.

8. The apparatus according to claim 7, wherein the setting module is further configured to perform envelop calculation for the target fingertip circling trajectory, and determine a minimum envelop space that accommodates the target fingertip circling trajectory;

and determine the standard circling trajectory corresponding to the target fingertip circling trajectory according to the minimum envelop space.

9. The apparatus according to claim 8, wherein

the first acquisition module is further configured to acquire a gesture action of the target fingertip in the set touch action occurrence area;

and

the processing module is further configured to perform a control operation matching with a set gesture action when the gesture action is identified as the set gesture action, and/or, enable a cursor to display a preset variation effect matching with the set gesture action.

10. The apparatus according to claim 7, wherein

the first acquisition module is further configured to acquire a gesture action of the target fingertip in the set touch action occurrence area;

and

the processing module is further configured to perform a control operation matching with a set gesture action when the gesture action is identified as the set gesture action, and/or, enable a cursor to display a preset variation effect matching with the set gesture action.

11. The apparatus according to claim 10, wherein the processing module is further configured to stop the touch response upon detecting that the target fingertip located in the set touch action occurrence area moves out of the touch action occurrence area for a period exceeding a preset threshold.

12. The apparatus according to claim 7, further comprising a second acquisition module configured to acquire space acceleration information of the wearable device collected by an acceleration sensor;

and

the determination module is further configured to modify the position information of the target fingertip according to the space acceleration information of the wearable device.

13. A wearable device, comprising:

binocular recognition means configured to collect position information of a target fingertip; and

a controller communicatively connected with the binocular recognition means and configured to acquire position information of the target fingertip collected by the binocular recognition means in a set touch action occurrence area;

determine a mapping point mapped on the screen of the wearable device for the target fingertip based on the position information of the target fingertip and the corresponding relationship; and

identify the mapping point on the screen of the wearable device;

said controller being further configured to set the touch action occurrence area before acquiring the position information of the target fingertip in the set touch action occurrence area by;

acquiring the target fingertip circling trajectory collected by binocular recognition means after receiving a trigger instruction for setting the touch action occurrence area and determining a standard circling trajectory corresponding to the target fingertip circling trajectory;

determining a reference point for establishing mapping between the target fingertip and the screen of the wearable device according to the standard circling trajectory and a boundary of the screen of the wearable device; and

setting the touch action occurrence area according to the reference point, the standard circling trajectory and the boundary of the screen of the wearable device; and

said controller being further configured to determine the mapping point according to the position information of the target fingertip and the reference point.

14. The wearable device according to claim 13, wherein the wearable device further comprises an acceleration sensor communicatively connected with the controller.

15. The wearable device according to claim 14, wherein the acceleration sensor is a gyro or a three-axis acceleration sensor.

16. The wearable device according to claim 13, wherein the wearable device is a smart watch that comprises a watch housing, the controller is positioned inside the watch housing, and the binocular recognition means is positioned on an outer edge of the watch housing.

17. The wearable device according to claim 16, wherein the binocular recognition means comprises a primary camera, a secondary camera, and a processing unit communicatively connected with the primary camera and the secondary camera respectively and configured to derive the position information of the target fingertip according to images captured by the primary camera and secondary camera.