Neural control holography

• US 9,588,490 B2
• Filed: 10/21/2014
• Issued: 03/07/2017
• Est. Priority Date: 10/21/2014
• Status: Active Grant

• Current Assignee: City University of Hong Kong
• Original Assignee: City University of Hong Kong
• Inventors: Tsang, Peter Wai Ming
• Primary Examiner(s): Won, Bumsuk
• Assistant Examiner(s): Alexander, William R
• Application Number:
  US14/520,272
• Publication Number:
  US 20160109851A1
• Time in Patent Office: 868 Days
• Field of Search: 359/1, 359/9, 359/13
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/08 Synthesising holograms, i.e. holograms synthesized from objects or objects from hologramsusing electric digital computers G06F; G06T
• CPC Class Codes: G03H 1/0866 Digital holographic imaging, i.e. synthesizing holobjects from holograms
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2227/02 Handheld portable device, e.g. holographic camera, mobile holographic display
• CPC Class Codes: G03H 2270/55 being an optical element, e.g. spectacles
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Abstract

Neural control of holograms is provided to facilitate improving the viewing pleasure of a viewer. A holographic processor component can generate holograms representing a multi-dimensional object scene. A sensor component can detect brain waves of the viewer at different frequency bands. The holographic processor component can analyze the brain waves at difference frequency bands to determine respective strengths of the brain waves at different frequency bands. The holographic processor component can determine an adjustment(s) to be made to a parameter(s) of an optical setting associated with the holograms based on the respective strengths of the brain waves at different frequency bands. The holographic processor component can adjust the optical setting for the holograms based on the parameter adjustment(s) to facilitate generating and displaying holograms that have been modified in response to the detected brain waves at different frequency bands to facilitate customizing the holograms for the viewer.

Claims

1. A system, comprising:

at least one memory that stores executable components; and

at least one processor that executes or facilitates execution of the executable components, comprising;

a detector component that detects a set of signals associated with brain activity of a brain of a user, wherein the set of signals comprises at least a first signal associated with a first frequency band and a second signal associated with a second frequency band; and

a holographic processor component that determines a set of optical parameters of the optical setting of a hologram and controls the set of optical parameters of the optical setting of the hologram, based at least in part on a result of an analysis of the set of signals that indicates a first signal strength of the first signal associated with the first frequency band with respect to the user and a second signal strength of the second signal associated with the second frequency band with respect to the user at a given time, to generate a processed hologram for presentation to the user, wherein the processed hologram represents an object scene, and wherein the set of optical parameters comprise at least one of a focus parameter, a zoom parameter, or a three-dimensional effect parameter relating to the optical setting of the hologram to facilitate the generation of the processed hologram.

2. The system of claim 1, wherein the holographic processor component analyzes the set of signals and the hologram to facilitate determining the set of optical parameters of the optical setting.

3. The system of claim 2, wherein the holographic processor component determines the set of optical parameters of the optical setting based at least in part on the result of the analysis of the set of signals and another result of the analysis of the hologram.

4. The system of claim 3, wherein the holographic processor component facilitates application of the set of optical parameters of the optical setting to the hologram to facilitate the generation of the processed hologram.

5. The system of claim 2, wherein the holographic processor component determines respective signal strengths of respective signals of the set of signals in respective frequency bands based at least in part on the result of the analysis of the set of signals, and wherein the respective signal strengths comprise the first signal strength and the second signal strength.

6. The system of claim 1, wherein the holographic processor component adjusts one or more optical parameters of the set of optical parameters to adjust the optical setting to adjust one or more visual characteristics associated with the hologram to facilitate the generation of the processed hologram to facilitate enhancement of a viewing pleasure of the user as the user views the processed hologram.

7. The system of claim 6, wherein, based at least in part on the result of the analysis of the set of signals, the holographic processor component adjusts the one or more optical parameters to facilitate the adjustment of the one or more visual characteristics associated with the hologram to reflect, and in response to, at least one of an emotional state of the user, a mental state of the user, or a physical state of the user as determined by the holographic processor component based at least in part on respective signal strengths of the respective signals in the respective frequency bands, and wherein the respective signal strengths comprise the first signal strength and the second signal strength.

8. The system of claim 6, wherein, based at least in part on the result of the analysis of the set of signals, to facilitate the generation of the processed hologram, the holographic processor component adjusts the one or more optical parameters to facilitate the adjustment of the one or more visual characteristics associated with the hologram to at least one of modify a visual quality of the hologram, modify a size of the hologram, modify a brightness level of the hologram, modify a contrast level of the hologram, modify an intensity of a three-dimensional effect of the hologram, modify a zoom level of all or a portion of a reconstructed object scene associated with the hologram that represents the object scene, modify a focal distance of an image from the hologram with regard to a viewpoint of the user with respect to the hologram, modify a focus of a reconstructed holographic image associated with the hologram, modify an overall distance between the object scene and the hologram, modify a depth range of the object scene associated with the hologram, or modify at least one of horizontal parallax or vertical parallax of the hologram.

9. The system of claim 1, wherein the holographic processor component determines that the first signal associated with the first frequency band has the first signal strength and the second signal associated with the second frequency band has the second signal strength.

10. The system of claim 9, wherein the holographic processor component determines a first optical parameter of the set of optical parameters based at least in part on the first signal strength associated with the first frequency band, and determines a second optical parameter of the set of optical parameters based at least in part on the second signal strength associated with the second frequency band.

11. The system of claim 1, further comprising a hologram generator component that is associated with the holographic processor component, wherein the hologram generator component generates the hologram representing the object scene, and facilitates the generation of the processed hologram based at least in part on the set of optical parameters of the optical setting applied to the hologram.

12. The system of claim 1, further comprising a display component that presents one or more reconstructed holographic images associated with the processed hologram to the user, in response to illumination of the processed hologram with a coherent light beam.

13. The system of claim 12, wherein the display component comprises or is associated with at least one of a head mount display device comprising communication and display functionality, a mobile phone, a computer, an electronic pad or tablet, or an electronic gaming device.

14. The system of claim 13, wherein the head mount display device comprises electronic glasses.

15. The system of claim 13, further comprising a sensor component comprising a set of sensor sub-components that sense brain wave signals based at least in part on the brain activity of the user, and communicates the set of signals to the holographic processor component, wherein the set of signals are determined based at least in part on the brain wave signals.

16. The system of claim 15, wherein one or more sensor sub-components of the sensor component are attached to or integrated with the head mount display device to facilitate the sensing of the brain wave signals.

17. The system of claim 15, wherein a subset of the set of sensor sub-components sense a physical response of the user in response to viewing at least one of the hologram or the processed hologram, or in response to experiencing stimuli in connection with viewing at least one of the hologram or the processed hologram.

18. A method, comprising:

receiving, by a system comprising a processing device, information relating to a set of brain wave signals associated with brain activity of a user, wherein the set of brain wave signals comprises at least a first brain wave signal associated with a first frequency band and a second brain wave signal associated with a second frequency band;

controlling, by the system, a set of parameters of an optical setting of a hologram, based at least in part on a result of an analysis of the information relating to the set of brain wave signals, to generate a modified hologram for presentation to the user, wherein the modified hologram represents an object scene, and wherein the result comprises a first signal strength of the first brain wave signal associated with the first frequency band with respect to the user and a second signal strength of the second brain wave signal associated with the second frequency band with respect to the user at a particular time; and

determining, by the system, the set of parameters of the optical setting of the hologram, based at least in part on the result of the analysis of the information relating to the set of brain wave signals, wherein the set of parameters of the optical setting are used to manage a set of visual attributes comprising at least one of a focus attribute, a zoom attribute, or a three-dimensional effect attribute associated with the hologram to facilitate generating the modified hologram.

19. The method of claim 18, further comprising:

monitoring, by the system, the set of brain wave signals associated with the brain activity of the user; and

sensing the set of brain wave signals, wherein the sensing the set of brain wave signals comprises sensing changes in the set of brain wave signals associated with the brain activity of the user in response to presentation of at least one of the hologram or the modified hologram to the user.

20. The method of claim 18, wherein the first brain wave signal associated with the first frequency band is an alpha wave signal and the second brain wave signal associated with the second frequency band is a beta wave signal.

21. The method of claim 18, further comprising:

analyzing, by the system, the information relating to the set of brain wave signals and the hologram to facilitate the determining of the set of parameters of the optical setting to use to facilitate modifying the hologram to generate the modified hologram.

22. The method of claim 18, wherein the determining the set of parameters of the optical setting of the hologram comprises determining the set of parameters of the optical setting to apply to the hologram based at least in part on the result of the analysis of the information relating to the set of brain wave signals and another result of a different analysis of the hologram.

23. The method of claim 18, further comprising:

modifying, by the system, at least one visual attribute, of the set of visual attributes, of the hologram, based at least in part on the set of parameters of the optical setting of the hologram, to facilitate generating the modified hologram.

24. The method of claim 23, wherein the at least one visual attribute comprises or relates to at least one of a visual quality of the hologram, a size of the hologram, a brightness level of the hologram, a contrast level of the hologram, an intensity of a three-dimensional effect of the hologram, a zoom level of all or a portion of a reconstructed object scene associated with the hologram that represents the object scene, a focal distance of an image from the hologram in relation to a viewpoint of the user with respect to the hologram, a focus of a reconstructed holographic image associated with the hologram, an overall distance between the object scene and the hologram, a depth range of the object scene associated with the hologram, a horizontal parallax associated with the hologram, or a vertical parallax associated with the hologram.

25. The method of claim 18, further comprising:

determining, by the system, respective signal strengths of respective brain wave signals of the set of brain wave signals based at least in part on the result of the analysis of the information relating to the set of brain wave signals, wherein the respective signal strengths comprise the first signal strength and the second signal strength.

26. The method of claim 18, further comprising:

determining, by the system, the first signal strength of the first brain wave signal associated with the first frequency band;

determining, by the system, the second signal strength of the second brain wave signal associated with the second frequency band;

determining, by the system, a first parameter of the set of parameters of the optical setting based at least in part on the first signal strength associated with the first frequency band; and

determining, by the system, a second parameter of the set of parameters of the optical setting based at least in part on the second signal strength associated with the second frequency band.

27. The method of claim 26, further comprising:

applying, by the system, the first parameter and the second parameter to one or more visual attributes of the hologram to facilitate the generating of the modified hologram, wherein the set of visual attributes comprises the one or more visual attributes.

28. The method of claim 18, further comprising:

generating, by the system, one or more reconstructed holographic images based at least in part on the modified hologram; and

displaying, by the system, the one or more reconstructed holographic images on a display device to facilitate presenting the one or more reconstructed holographic images to the user.

29. The method of claim 18, wherein the modified hologram is a three-dimensional full-parallax hologram comprising horizontal parallax and vertical parallax, and the object scene is a three-dimensional object scene.

30. A non-transitory computer-readable medium storing computer-executable instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

detecting a set of signals associated with brain activity of a brain of a user, wherein the set of signals comprises at least a first signal associated with a first frequency band and a second signal associated with a second frequency band;

managing a set of parameters of an optical setting of a hologram, based at least in part on a result of an analysis of the set of signals that relates to a first signal level of the first signal associated with the first frequency band with respect to the user and a second signal level of the second signal associated with the second frequency band with respect to the user at a given time, to generate a modified hologram for presentation to the user, wherein the modified hologram represents an object scene; and

determining the set of parameters of the optical setting of the hologram based at least in part on the result of the analysis of the set of signals, wherein the set of parameters of the optical setting are used to facilitate adjusting a set of visual characteristics associated with the hologram to facilitate generating the modified hologram.

31. The non-transitory computer-readable medium of claim 30, wherein the operations further comprise:

analyzing the set of signals and the hologram to facilitate determining the set of parameters of the optical setting;

determining at least the first signal level of the first signal associated with the first frequency band and the second signal level of the second signal associated with the second frequency band based at least in part on the result of the analyzing the signals; and

translating the first signal level and the second signal level to one or more parameters of the set of parameters of the optical setting based at least in part on a mapping of respective signals strengths of signals in respective frequency bands to parameters for optical settings, wherein the determining the set of parameters comprises determining the set of parameters of the optical setting based at least in part on the translating; and

applying the one or more parameters of the set of parameters of the optical setting to facilitate adjusting one or more visual characteristics associated with the hologram to facilitate generating the modified hologram, wherein the set of visual characteristics comprises the one or more visual characteristics.

32. A system, comprising:

means for receiving information relating to a set of brain wave signals associated with brain activity of a user, wherein the set of brain wave signals comprises at least a first brain wave signal associated with a first frequency band and a second brain wave signal associated with a second frequency band;

means for controlling a set of parameters of an optical setting of a hologram, based at least in part on a result of an analysis of the information relating to the set of brain wave signals, to generate a processed hologram for presentation to the user, wherein the processed hologram represents an object scene, and wherein the result relates to a first signal strength of the first brain wave signal associated with the first frequency band with respect to the user and a second signal strength of the second brain wave signal associated with the second frequency band with respect to the user at a particular time;

means for determining the set of parameters of the optical setting of the hologram based at least in part on the result of the analysis of the information relating to the set of brain wave signals; and

means for adjusting one or more visual characteristics associated with the hologram, based at least in part on one or more parameters of the set of parameters of the optical setting of the hologram, to facilitate generating the processed hologram.

33. The system of claim 32, wherein the system further comprises:

means for analyzing the information relating to the set of brain wave signals to generate the result of the analysis of the information, to facilitate determining the set of parameters of the optical setting of the hologram.