Methods and apparatus for jammable HCI interfaces

• US 9,448,066 B2
• Filed: 04/17/2013
• Issued: 09/20/2016
• Est. Priority Date: 04/17/2012
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Follmer, Sean, Leithinger, Daniel, Ishii, Hiroshi, Olwal, Alex
• Primary Examiner(s): Le, Toan
• Assistant Examiner(s): Aiello, Jeffrey
• Application Number:
  US13/864,663
• Publication Number:
  US 20130275082A1
• Time in Patent Office: 1,252 Days
• Field of Search: 324/334, 324/344, 324/658, 324/72, 345/174, 345/173, 345/175, 345/156, 702/11
• US Class Current: 1/1
• CPC Class Codes: G01B 21/00 Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
• CPC Class Codes: G01B 21/20 for measuring contours or curvatures, e.g. determining profile
• CPC Class Codes: G06F 2203/04102 Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• CPC Class Codes: G06F 2203/04103 Manufacturing, i.e. details related to manufacturing processes specially suited for touch sensitive devices
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0443 using a single layer of sensing electrodes
• CPC Class Codes: G06F 3/0447 Position sensing using the local deformation of sensor cells

Abstract

In exemplary implementations of this invention, a jammable structure functions as an HCI interface. A user provides input by changing the shape of a flexible layer of the jammable structure (e.g., by pressing against it or stretching, twisting or bending it) and receives haptic feedback (e.g., varying stiffness). Sensors are used to determine the shape of the flexible layer. The sensors output data that is indicative of electromagnetic waves that have traveled through the jammable media or of electrical or magnetic phenomena that are produced by the waves. For example, visible or infrared light may be shone through a transparent jammable media to the flexible layer and reflect back to a camera. The media may comprise granular particles (e.g., glass beads) and a liquid (e.g., oil) with matching indices of refraction. Or capacitive sensing may be used to detect the shape of the flexible layer.

Claims

1. A method of detecting the shape of a flexible layer of a jammable structure, wherein:

(a) the jammable structure comprises a jammable media and a container that contains the jammable media;

(b) the container comprises, at least in part, the flexible layer;

(c) the jammable media comprises granular particles and interstitial fluid that have matching indices of refraction;

(d) the jammable media has a stiffness that varies depending on how closely the granular particles are packed; and

(e) the method comprises, in combination,

(i) one or more optical sensors taking measurements of infrared or visible light that has traveled through the jammable media, and

(ii) one or more processors analyzing the measurements to determine the shape of the flexible layer.

2. The method of claim 1, wherein the interstitial fluid comprises a liquid.

3. The method of claim 2, wherein the waves comprise structured infrared light.

4. The method of claim 2, wherein the measurements are indicative of a optical pattern printed on a side of the surface.

5. The method of claim 2, wherein:

(a) the one or more optical sensors comprise at least two cameras; and

(b) the method further comprises the one or more processors etermining the shape based at least in part on stereopsis indicated by the measurements.

6. The method of claim 2, wherein:

(a) the waves originate from multiple lights sources, which light sources either are of differing colors or are illuminated in a temporal sequence; and

(b) the method further comprises the one or more processors analyzing data indicative of shadows to determine the shape.

7. The method of claim 2, wherein the method further comprises using frustrated total internal reflection to determine positions at which a human is pressing against the surface.

8. Apparatus comprising, in combination:

(a) a jammable structure that comprises

(i) jammable media, which jammable media

(A) comprises granular particles and interstitial fluid that have matching indices of refraction, and

(B) has a stiffness that is variable, depending on how closely the granular particles are packed, and

(ii) a container for containing the jammable media, which container comprises, at least in part, a flexible layer;

(b) one or more optical sensors configured to take measurements of infrared or visible light that has traveled through the jammable media; and

(c) one or more processors which are configured to analyze the measurements to determine shape of the flexible layer.

9. The apparatus of claim 8, wherein the jammable structure is part of, or configured to be affixed to, a mobile electronic device.

10. The apparatus of claim 8 wherein the interstitial fluid comprises a liquid.