Apparatus and method for effecting a control action in respect of system functions

• US 10,216,273 B2
• Filed: 02/23/2016
• Issued: 02/26/2019
• Est. Priority Date: 02/25/2015
• Status: Active Grant

• Current Assignee: BAE Systems Plc
• Original Assignee: BAE Systems Plc
• Inventors: Colosimo, Nicholas Giacomo Robert, Wright, Julian David, Whiteford, Christopher James
• Primary Examiner(s): Balaoing, Ariel A
• Application Number:
  US15/552,662
• Publication Number:
  US 20180188806A1
• Time in Patent Office: 1,099 Days
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

An apparatus for effecting a control action in respect of a function within a virtual or mixed reality system, the control action corresponding to a predefined bodily movement of an authorized user of said function, wherein an authorized user is defined by a predetermined criterion in respect of a selected body part and/or a passive device carried thereon. The apparatus comprises a detection module for detecting a predefined bodily movement; a multi-spectral imaging system for capturing spectral reflectance and/or emission data at a plurality of wavelengths in respect of said selected body part and/or the passive device carried thereon; and an analysis module for comparing at least a portion of the spectral data with data corresponding to an authorized user of said function to determine if said criterion is met, and outputting a signal to effect said control action only if said criterion is met.

Claims

1. A control apparatus for effecting a control action in respect of a function within a virtual or mixed reality system, said control action corresponding to a predefined bodily movement of an authorised user of said function, wherein an authorised user of said function is defined by a predetermined criterion in respect of a selected body part and/or a passive device carried thereon;

said authorised user of said function further defined by a predetermined criterion in respect of a garment worn by said user, said garment having a predefined spectral characteristic;

the apparatus comprising;

a detection module for detecting a predefined bodily movement made by a user to effect a control action in respect of a selected function of said system;

a storage module having stored therein data representative of one or more spectral characteristics corresponding to respective one or more authorised garments registered in respect of said virtual or mixed reality system;

a multi-spectral imaging system for capturing spectral reflectance and/or emission data at a plurality of wavelengths in respect of said selected body part of said user and/or a passive device carried thereon; and

an analysis module for analysing said spectral data, comparing at least a portion thereof with predetermined data corresponding to an authorised user of said selected function to determine if said predetermined criterion for that function is met, and outputting a signal to effect said control action in respect of said selected function only if said predetermined criterion is met;

wherein said analysis module includes a matching module for, in response to detection of a predefined bodily movement of a user;

receiving data representative of a spectrum derived from spectral reflectance and/or emission data captured by said multi-spectral imaging system in respect of said garment;

comparing said data with said stored data to determine a match with that of a registered authorised garment for a selected function in respect of which said bodily movement has been detected;

wherein said analysis module is configured to output said signal to effect said control action in respect of said selected function only if a match is determined.

2. The apparatus according to claim 1, wherein said body part is a user'"'"'s hand and said predefined bodily movement is a predetermined hand gesture.

3. The apparatus according to claim 1, wherein said detection module includes an image capture device for capturing images of users in respect of said virtual or mixed reality system, and wherein said detection module is configured to identify one or more predefined bodily movements of one or more said users.

4. The apparatus according to claim 1, comprising:

said storage module having stored therein data representative of one or more spectra corresponding to respective one or more authorised users'"'"' body part(s) registered in respect of said virtual or mixed reality system;

wherein said analysis module includes a matching module for, in response to detection of a predefined bodily movement of a user, receiving data representative of a spectrum derived from spectral reflectance and/or emission data captured by said multi-spectral imaging system in respect of said user'"'"'s selected body part;

comparing said data with said stored data to determine a match with that of a registered authorised user of a selected function in respect of which said bodily movement has been detected;

wherein said analysis module is configured to output said signal to effect said control action in respect of said selected function only if a match is determined.

5. The apparatus according to claim 1, wherein said garment is a glove worn on a user'"'"'s hand, and said predefined bodily movement is a predetermined hand gesture.

6. The apparatus according to claim 1, further comprising:

at least one image capture device for capturing images of users in respect of said virtual or mixed reality system;

an image matching module for extracting images from said captured images corresponding to predefined bodily movements of one or more of said users; and

identifying, from said extracted images, a predefined bodily movement in respect of a selected function.

7. A mixed reality system comprising:

a headset for placing over a user'"'"'s eyes, in use, said headset including a screen, the system further comprising

a processor configured to receive data from one or more sources and display said data on said screen within a three-dimensional virtual environment;

wherein said system facilitates a plurality of selective functions in respect of said data, said selected functions being actuable by a respective control action corresponding to a predefined bodily movement of an authorised user of said function, the system further comprising;

a control apparatus for effecting a control action in respect of a function within said mixed reality system, said control action corresponding to a predefined bodily movement of an authorised user of said function, wherein an authorised user of said function is defined by a predetermined criterion in respect of a selected body part and/or a passive device carried thereon, the apparatus comprising;

a detection module for detecting a predefined bodily movement made by a user to effect a control action in respect of a selected function of said system;

a multi-spectral imaging system for capturing spectral reflectance and/or emission data at a plurality of wavelengths in respect of said selected body part of said user and/or a passive device carried thereon; and

an analysis module for analysing said spectral data, comparing at least a portion thereof with predetermined data corresponding to an authorised user of said selected function to determine if said predetermined criterion for that function is met, and outputting a signal to effect said control action in respect of said selected function only if said predetermined criterion is met;

wherein an authorised user of said function is defined by a predetermined criterion in respect of a garment worn by said user, said garment having a predefined spectral characteristic;

a storage module having stored therein data representative of functions and spectral wavelengths corresponding thereto;

wherein said analysis module comprises a comparison function for receiving data representative of a spectrum derived from spectral reflectance and/or emission data captured by said multi-spectral imaging system in respect of said garment;

identifying from said storage module a spectral wavelength corresponding to a selected function in respect of which said bodily movement has been detected;

comparing the spectral component of said data corresponding to said identified wavelength with a predetermined threshold; and

outputting said signal to effect said control action in respect of said selected function only if the magnitude of said spectral component exceeds said predetermined threshold.

9. The system according to claim 7, wherein said body part is a user'"'"'s hand and said predefined bodily movement is a predetermined hand gesture.

10. The system according to claim 7, wherein said detection module includes an image capture device for capturing images of users in respect of said virtual or mixed reality system, and wherein said detection module is configured to identify one or more predefined bodily movements of one or more said users.

11. The system according to claim 7, comprising:

a storage module having stored therein data representative of one or more spectra corresponding to respective one or more authorised users'"'"' body part(s) registered in respect of said virtual or mixed reality system;

wherein said analysis module includes a matching module for, in response to detection of a predefined bodily movement of a user, receiving data representative of a spectrum derived from spectral reflectance and/or emission data captured by said multi-spectral imaging system in respect of said user'"'"'s selected body part;

comparing said data with said stored data to determine a match with that of a registered authorised user of a selected function in respect of which said bodily movement has been detected;

wherein said analysis module is configured to output said signal to effect said control action in respect of said selected function only if a match is determined.

12. The system according to claim 7, wherein said garment is a glove worn on a user'"'"'s hand, and said predefined bodily movement is a predetermined hand gesture.

13. The system according to claim 7, further comprising:

at least one image capture device for capturing images of users in respect of said virtual or mixed reality system;

an image matching module for extracting images from said captured images corresponding to predefined bodily movements of one or more of said users; and

identifying, from said extracted images, a predefined bodily movement in respect of a selected function.

8. A method of controlling access to functions and/or information within a virtual or mixed reality system, said control action corresponding to a predefined bodily movement of an authorised user of said function, wherein an authorised user of said function is defined by a predetermined criterion in respect of a selected body part and/or a passive device carried thereon, the method comprising:

providing a detection module for detecting a predefined bodily movement made by a user to effect a control action in respect of a selected function of said system;

providing a multi-spectral imaging system for capturing spectral reflectance and/or emission data at a plurality of wavelengths in respect of said selected body part of said user and/or a passive device carried thereon; and

configuring an analysis module to analyse said spectral data by comparing at least a portion thereof with predetermined data corresponding to an authorised user of said selected function to determine if said predetermined criterion for that function is met, and outputting a signal to effect said control action in respect of said selected function only if said predetermined criterion is met;

wherein an authorised user of said function is defined by a predetermined criterion in respect of a garment worn by said user, said garment having a predefined spectral characteristic;

a storage module having stored therein data representative of functions and spectral wavelengths corresponding thereto;

wherein said analysis module comprises a comparison function for receiving data representative of a spectrum derived from spectral reflectance and/or emission data captured by said multi-spectral imaging system in respect of said garment;

identifying from said storage module a spectral wavelength corresponding to a selected function in respect of which said bodily movement has been detected;

comparing the spectral component of said data corresponding to said identified wavelength with a predetermined threshold; and

outputting said signal to effect said control action in respect of said selected function only if the magnitude of said spectral component exceeds said predetermined threshold.