Wearable interactive user interface

• US 10,642,356 B1
• Filed: 06/21/2017
• Issued: 05/05/2020
• Est. Priority Date: 06/26/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Wang, Paul X., Gao, Zheng, Nasiri Mahalati, Reza, Chang, Ray L.
• Primary Examiner(s): Danielsen, Nathan
• Application Number:
  US15/629,619
• Time in Patent Office: 1,049 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface

Abstract

Embodiments are directed to a user input device and methods related to the use thereto. In one aspect, an embodiment includes a flexible fabric attachable to a user having a first portion and a second portion. The first portion may be moveable in relation to the second portion. The embodiment may further include a controller configured to identify an input configuration based on a position of the first portion relative to a position of the second portion within a three-dimensional space. The embodiment may further include a haptic feedback structure disposed adjacent the flexible fabric and configured to provide haptic feedback based on the input configuration.

Claims

1. A user input device, comprising:

a flexible fabric configured to attach to a user and comprising;

a first portion;

a primary sensing region forming part of the first portion;

a second portion moveable in relation to the first portion; and

a secondary sensing region forming part of the second portion, wherein the primary sensing region spans a larger area on the flexible fabric than the secondary sensing region and wherein the primary and secondary sensing regions comprise at least one of an accelerometer, a gyrometer, and a capacitive array;

a controller configured to identify an input configuration based on a position of the first portion relative to a position of the second portion within a three-dimensional space; and

a haptic feedback structure disposed adjacent the flexible fabric and configured to provide haptic feedback based on the input configuration, wherein the haptic feedback comprises first haptic feedback at the primary sensing region and second haptic feedback at the secondary sensing region and wherein the first haptic feedback is different from the second haptic feedback.

2. The user input device of claim 1,

wherein the controller is further configured to:

receive a first output associated with the primary sensing region and indicative of the position of the first portion; and

receive a second output associated with the secondary sensing region and indicative of the position of the second portion.

3. The user input device of claim 1, wherein the flexible fabric defines a touch-sensitive surface proximal to the first portion and configured to sense a touch input.

4. The user input device of claim 1, wherein the controller is configured to identify movements of the first and second portions that do not correspond to the identified input configuration.

5. The user input device of claim 1, wherein at least one of the first portion and the second portion is configured to exert a suction force on the user to attach the flexible fabric to the user.

6. The user input device of claim 1, wherein the haptic feedback structure comprises a flexible bladder configured to expand in response to an internal force.

7. The user input device of claim 6, wherein the expansion of the flexible bladder conforms the flexible bladder to a shape of the user.

8. The user input device of claim 6, wherein the haptic feedback structure comprises a textured surface.

9. The user input device of claim 8, wherein the textured surface is configured to translate relative to the user, thereby providing the haptic feedback.

10. The user input device of claim 1, wherein the flexible fabric defines a glove.

11. The user input device of claim 1, wherein the flexible fabric further comprises:

a stiffening element extending between the first and second portions and configured to stiffen in response to at least one of a magnetic force or a temperature change.

12. A user input device, comprising:

a first attachment piece configured for attachment to a user at a first location;

a second attachment piece configured for attachment to the user at a second location;

a sensor coupled to the first and the second attachment pieces and configured to determine a position of the first attachment piece relative to a position of the second attachment piece, wherein the sensor comprises at least one of an accelerometer, a gyrometer, and a capacitive array;

a touch sensor that receives touch input from a user'"'"'s finger;

a haptic feedback structure that provides haptic feedback in response to the touch input, wherein the haptic feedback is one of first and second types of haptic feedback; and

a controller configured to;

identify an input configuration based on the position of the first and second attachment pieces, wherein the input configuration is one of first and second input configurations;

generate a user input signal based on the identified input configuration; and

provide the first type of haptic feedback with the haptic feedback structure when the input configuration is the first input configuration and provide the second type of haptic feedback when the input configuration is the second input configuration.

13. The user input device of claim 12, wherein the first attachment piece is configured to deform in response to a force.

14. The user input device of claim 13, wherein at least one of the first or second attachment pieces comprises a mechanical switch configured to produce an electrical response in response to deformation of the first attachment piece.

15. The user input device of claim 14, wherein:

the mechanical switch comprises a strain-sensitive element; and

the strain-sensitive element is configured to provide haptic feedback.

16. The user input device of claim 12, wherein:

the first location is a first finger of the user; and

the second location is a second finger of the user.

17. The user input device of claim 12, wherein the first attachment piece further comprises a dynamically configurable light source configured to display an output.

18. The user input device of claim 17, wherein the output comprises a keyboard shape.

19. The user input device of claim 18, wherein the input configuration corresponds to the position of the second attachment piece relative to a position of the keyboard shape.

20. The user input device of claim 12, wherein:

the first attachment piece is coupled with a docking station; and

the first attachment piece is configured to receive an electrical signal from the docking station.

30. The user input device of claim 12, wherein the first input configuration is a cursor control input configuration and the second input configuration is a keyboard input configuration.

21. A user input device, comprising:

a first attachment piece configured for attachment to a user at a first location;

a second attachment piece configured for attachment to the user at a second location;

a sensor coupled to the first and the second attachment pieces and configured to determine a position of the first attachment piece relative to a position of the second attachment piece, wherein the sensor comprises;

a first gyrometer having a first size; and

a second gyrometer having a second size that differs from the first size; and

a controller configured to;

identify an input configuration based on the position of the first and second attachment pieces; and

generate a user input signal based on the identified input configuration.

22. A method of operating a user input device, comprising:

positioning a flexible fabric to define an input configuration, wherein the flexible fabric comprises a force sensor that receives force input from a user'"'"'s finger;

determining, through measurement circuitry, a time taken to position the flexible fabric in the input configuration;

determining, through the measurement circuitry, the position of the flexible fabric in the input configuration;

generating an output signal based on the time, the position of the flexible fabric in the input configuration, and the force input; and

generating haptic feedback through the flexible fabric in response to the force input, wherein the haptic feedback is determined based at least partly on the input configuration.

23. The method of claim 22, wherein the haptic feedback is generated based on the time and the position of the flexible fabric in the input configuration.

24. The method of claim 22, wherein:

the input configuration is a first input configuration, the first input configuration corresponding to a first predetermined function executable by a separate computing device; and

the method further comprises;

positioning the flexible fabric to define a second input configuration corresponding to a second predetermined function executable by the separate computing device.

25. The method of claim 24, further comprising:

receiving a dynamic feedback signal from the separate computing device, the dynamic feedback signal based, at least in part, on the flexible fabric being in the first input configuration or the second input configuration.

26. The method of claim 25, wherein:

the flexible fabric includes a magnetic element; and

the dynamic feedback signal comprises a magnetic field generated at the separate computing device, the magnetic field configured to cause a force to be exerted on the flexible fabric.

27. The method of claim 25, further comprising:

generating additional haptic feedback based on the dynamic feedback signal.

28. The method of claim 25, wherein:

the separate computing device includes a display having an indicium corresponding to the first input configuration or the second input configuration.

29. The method of claim 22, further comprising:

transmitting a user input signal to a virtual reality device, the user input signal corresponding to the time and the position of the flexible fabric in the input configuration,

wherein the virtual reality device is configured to represent the flexible fabric within an immersive three-dimensional environment based on the user input signal.