SYSTEM FOR DETECTING FACIAL MOVEMENTS OVER A FACE OF A USER

• US 20200133387A9
• Filed: 05/24/2018
• Published: 04/30/2020
• Est. Priority Date: 05/24/2017
• Status: Abandoned Application

• Current Assignee: Silicon Algebra Incorporated
• Original Assignee: Silicon Algebra Incorporated
• Inventors: Lee, Kevin, Reyes, Ivan Roberto, Pella, John P., DeWolf, Quentin
• Application Number:
  US15/989,113
• Publication Number:
  US 20190361519A1
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A system for detecting facial movements of a user includes: a sensor assembly including: an elastic member 110 configured to couple to a headset and contact a face of a user, proximal and offset from ocular regions of the face of the user and a substrate that defines a set of discrete electrical channels and a set of electrode tabs distributed along the elastic member, wherein each electrode tab is configured to proximally contact a muscular region on the face of the user; and a controller configured to sample a set of sense signals from the set of electrode tabs via the set of discrete electrical channels and to interpret changes in the set of sense signals over time as expressions on the face of the user when the headset is worn by the user.

Claims

1. A system comprising:

a sensor assembly comprising;

an elastic member;

configured to couple to a headset,

configured to contact a face of a user, proximal and offset from ocular regions of the face of the user, when the headset is worn by the user, and

comprising a compressible material configured to conform to the face of the user when the headset is worn by the user;

a substrate arranged across an exterior surface of the elastic member and defining a set of discrete electrical channels;

a set of electrode tabs distributed along the elastic member, each electrode tab;

configured to proximally contact a muscular region on the face of the user when the headset is worn by the user;

comprising a sense electrode defining an electrical contact surface facing outwardly from an interior surface of the elastic member opposite the substrate and configured to contact skin on the face of the user when the headset is worn by the user; and

comprising an enclosed trace extending from the sense electrode at the interior face of the elastic member to a discrete electrical channel, in the set of discrete electrical channels, at the exterior face of the elastic member; and

a controller configured to;

sample a set of sense signals from the set of electrode tabs via the set of discrete electrical channels; and

to interpret changes in the set of sense signals over time as expressions on the face of the user when the headset is worn by the user.

2. The system of claim 1, wherein the elastic member comprises a continuous elastic member extending along supraorbital regions and zygomatic regions of the face of the user and offset from ocular regions of the face of the user when the headset is worn by the user.

6. The system of claim 1:

wherein the elastic member is;

coupled to the headset, comprising a pair of optical glasses; and

configured to contact the face of the user, proximal to supraorbital regions of the face of the user and offset from ocular regions of the face of the user, when the headset is worn by the user; and

further comprising a second elastic member configured to contact a nasal bridge region of the face of the user and offset from ocular regions of the face of the user, when the headset is worn by the user; and

further comprising a second set of the electrode tabs distributed along the second elastic member; and

wherein the controller is configured to;

sample a second set of sense signals from the second set of electrode tabs; and

to interpret changes in the set of sense signals and the second set of sense signals over time as expressions on the face of the user when the headset is worn by the user.

7. The system of claim 6, wherein:

the set of electrode tabs comprises;

an upper left sense electrode coupled to the frame and configured to proximally contact a left upper orbicularis oculi muscular region of the face of the user when the headset is worn by the user; and

an upper right sense electrode coupled to the frame and configured to proximally contact a right upper orbicularis oculi muscular region of the face of the user when the headset is worn by the user; and

the second set of electrode tabs comprises;

a left nose pad sense electrode coupled to the internal surface of the nose pads of the headset and configured to proximally contact a left levator labii superioris alaeque nasi muscular region of the face of the user when the headset is worn by the user; and

a right nose pad sense electrode coupled to the internal surface of the nose pads of the headset and configured to proximally contact a right levator labii superioris alaeque nasi muscular region of the face of the user when the headset is worn by the user.

8. The system of claim 1, further comprising a reference electrode tab:

coupled to the elastic member;

configured to contact a low-muscle region on the face of the user when the headset is worn by the user;

comprising a reference electrode defining an electrical contact surface facing outwardly from an interior face of the elastic member opposite the substrate and configured to contact skin on the face of the user when the headset is worn by the user; and

electrically coupled to an electrical channel, in the set of electrical channels, defined on the substrate.

9. The system of claim 1, wherein each electrode tab in the set of electrode tabs comprises:

a base layer comprising a nonconductive polymer;

the sense electrode further comprising conductive ink deposited across a first surface of the base layer;

a junction pad comprising conductive ink deposited across the first surface of the base layer;

the enclosed trace further comprising;

an electrical trace comprising conductive ink deposited between the junction pad and the sense electrode across the first surface of the base layer; and

a nonconductive cover layer bonded to the base layer and enclosing the electrical trace between the nonconductive cover layer and the base layer.

10. The system of claim 9 wherein, for each electrode tab in the set of electrode tabs:

the base layer comprises thermoplastic polyurethane;

the conductive ink comprises silver ink; and

the sense electrode further comprises a silver chloride coating, preventing oxidation of the silver ink.

11. The system of claim 9, wherein, for each electrode tab in the set of electrode tabs:

the base layer is bonded to an interior surface of the substrate, the base layer interposed between the substrate and the elastic member, and the junction pad contacting a discrete electrical channel in the set of electrical channels on the substrate;

the base layer further defines a second surface, opposite the first surface of the base layer, that contacts an outer perimeter surface of the elastic member and is coupled to the interior surface of the elastic member; and

the sense electrode of each electrode tab in the set of electrode tabs faces outwardly from the first surface of the base layer and is configured to contact skin on the face of the user when the headset is worn by the user.

12. The system of claim 1, wherein the substrate and the electrode tabs form a unitary structure defining:

a substrate ring defining the set of discrete electrical channels and a common junction and conforming to the geometry of the elastic member;

for each electrode tab in the set of sense electrodes tabs, an electrode tab area defining the electrode tab and extending radially from a perimeter of the substrate ring; and

a cover layer covering the set of discrete electrical channels, the enclosed traces in the set of electrode tabs, and the common junction.

13. The system of claim 1, wherein:

the controller is arranged remote from the sensor assembly and connected to the sensor assembly via a common junction in the set of discrete electrical channels; and

the sensor assembly is replaceable with a second sensor assembly comprising;

a second elastic member;

configured to couple to a headset,

configured to contact a face of a user, proximal and offset from ocular regions of the face of the user, when the headset is worn by the user, and

comprising a compressible material configured to conform to the face of the user when the headset is worn by the user;

a second substrate arranged across an exterior surface of the second elastic member and defining a second set of discrete electrical channels and a second common junction of the second set of discrete electrical channels;

a second set of electrode tabs distributed along the second elastic member, each electrode tab;

configured to proximally contact a muscular region on the face of the user when the headset is worn by the user;

comprising a sense electrode defining an electrical contact surface facing outwardly from an interior surface of the second elastic member opposite the second substrate and configured to contact skin on the face of the user when the headset is worn by the user; and

comprising an enclosed trace extending from the sense electrode at the interior face of the second elastic member to a discrete electrical channel, in the second set of discrete electrical channels, at the exterior face of the second elastic member; and

the controller is configured to connect to the second sensor assembly via the second common junction of the second sensor assembly.

3. The system of claim 0, wherein the set of electrode tabs comprises:

a lower left electrode tab configured to proximally contact a left zygomaticus muscular region or a left levator labii superioris muscular region of the face of the user when the headset is worn by the user;

an upper left electrode tab configured to proximally contact a left upper orbicularis oculi muscular region of the face of the user when the headset is worn by the user;

a lower right electrode tab configured to proximally contact a right zygomaticus or a right levator labii superioris muscular region of the face of the user when the headset is worn by the user; and

an upper right electrode tab configured to proximally contact a right upper orbicularis oculi muscular region of the face of the user when the headset is worn by the user.

4. The system of claim 3, wherein the controller is further configured to output the expressions to a game console for representation on a virtual avatar in a virtual environment rendered on the headset.

5. The system of claim 4, wherein the elastic member is configured to transiently couple to the headset via a hook-and-loop attachment surface arranged over the substrate, the hook-and-loop attachment surface configured to align with a corresponding hook-and-loop attachment surface on the headset.

14. A manufacturing method comprising:

applying a layer of conductive ink to an exterior surface of a flexible substrate to form;

a set of sense electrodes;

a common junction; and

a set of electrical traces, each electrical trace connecting each sense electrode in the set of sense electrodes to a corresponding electrical channel of the common junction.

applying a non-oxidative conductive layer over the set of sense electrodes;

applying a nonconductive cover layer over the set of electrical traces;

selectively cutting the flexible substrate around the applied layer of conductive ink to define;

a substrate ring comprising the set of electrical traces and the common junction; and

a set of electrode tabs extending radially from the substrate ring, each electrode tab in the set of electrode tabs comprising a sense electrode in the set of sense electrodes;

assembling a sensor assembly by adhering;

an interior surface of the substrate ring to an exterior surface of an elastic member configured to conform to a face of a user offset from the ocular regions of the face of the user; and

an interior surface of each electrode tab in the set of electrode tabs to an interior surface of the elastic member; and

applying an adherent to an exterior surface of the sensor assembly, the adherent configured to transiently couple the sensor assembly to a view window of a virtual reality headset.

15. The manufacturing method of claim 14, further comprising:

electrically coupling the common junction to a virtual reality headset; and

adhering the exterior surface of the sensor assembly comprising the adherent to the view window of the virtual reality headset, the set of sense electrodes contacting the face of the user when the headset is worn by the user.

16. The manufacturing method of claim 14, wherein applying the adherent to an exterior surface of the sensor assembly further comprises applying a hook-and-loop attachment surface to the exterior surface of the sensor assembly, the hook-and-loop attachment surface configured to transiently couple to a corresponding hook-and-loop attachment surface around the view window of the virtual reality headset.

17. The manufacturing method of claim 14, wherein:

applying the layer of conductive ink to the flexible substrate comprises applying a layer of silver ink to thermoplastic polyurethane;

applying the non-oxidative conductive layer over the set of sense electrodes comprises applying a layer of silver chloride over the set of sense electrodes; and

applying the nonconductive cover layer over the set of electrical traces and the common junction comprises applying a layer of thermoplastic polyurethane over the set of electrical traces and the common junction.

18. A manufacturing method comprising:

applying a layer of conductive ink to an exterior surface of a flexible substrate to form;

a common junction;

a set of electrical pads; and

a set of electrical channels, each electrical channel connecting each electrical pad in the set of electrical pads to a corresponding electrical channel of the common junction;

selectively cutting the flexible substrate around the applied layer of conductive ink to define a substrate ring comprising the set of electrical pads, the set of electrical channels, and the common junction;

applying a layer of conductive ink to a flexible polymer sheet to form a set of electrode tabs, each electrode tab comprising;

a junction pad;

a sense electrode; and

an electrical trace connecting the junction pad and the sense electrode;

for each electrode tab in the set of electrode tabs, separating the electrode tab from the flexible polymer sheet;

assembling an electrode-substrate assembly by adhering, for each electrode tab in the set of electrode tabs, the junction pad of the electrode tab to an electrical pad in the set of electrical pads on the substrate ring;

assembling a sensor assembly by adhering;

an interior surface of the substrate ring of the electrode-substrate assembly to an exterior surface of an elastic member configured to conform to a face of a user offset from the ocular regions of the face of the user; and

an interior surface of each electrode tab in the set of electrode tabs to an interior surface of the elastic member; and

applying an adherent to an exterior surface of the sensor assembly, the adherent configured to transiently couple the sensor assembly to a view window of a virtual reality headset.

19. The manufacturing method of claim 18, further comprising:

electrically coupling the common junction to the virtual reality headset; and

adhering an exterior surface of the sensor assembly comprising the adherent around the view window of the virtual reality headset, the set of sense electrodes contacting the face of the user when the headset is worn by the user.

20. The manufacturing method of claim 18, further comprising applying a layer of silver chloride to the sense electrode to prevent oxidation of the electrical contact surface.