Cognitive displays

• US 9,783,204 B2
• Filed: 02/02/2015
• Issued: 10/10/2017
• Est. Priority Date: 02/02/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Gordon, Michael S., Kozloski, James R., Malkin, Peter K., Pickover, Clifford A.
• Primary Examiner(s): Ghulamali, Qutbuddin
• Application Number:
  US14/612,064
• Publication Number:
  US 20160229412A1
• Time in Patent Office: 981 Days
• Field of Search: 340576, 340500
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/25 to the sides of the vehicle
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/8026 in addition to a rear-view mirror system
• CPC Class Codes: B60W 2040/0818 Inactivity or incapacity of driver
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness

Abstract

A cognitive mirror apparatus includes an imaging device configured to capture a plurality of images, a controller configured to determine a cognitive state of a user; and a cognitive mirror configured to display a virtual reflection comprising one or more of the plurality of images, wherein the virtual reflection of the cognitive mirror is determined using the cognitive state of a user.

Claims

1. A method for controlling a cognitive mirror apparatus, the method comprising:

capturing, by an imaging device of the cognitive mirror apparatus, a plurality of images;

capturing, by a sensor of the cognitive mirror apparatus, one or more parameters indicative of a cognitive state of a user including at least one of eye movement, facial expression, posture, and pulse;

receiving, by a controller of the cognitive mirror apparatus, the one or more parameters from the sensor;

mapping, by the controller, the one or more parameters indicative of the cognitive state of the user to a controllable parameter of a cognitive mirror of the cognitive mirror apparatus; and

displaying, by the cognitive mirror of the cognitive mirror apparatus, a virtual reflection comprising one or more of the plurality of images adjusted using the controllable parameter of the cognitive mirror, wherein the virtual reflection is iteratively updated by sampling the one or more parameters indicative of the cognitive state of the user and mapping sampled parameters indicative of the cognitive state of the user to adjust the controllable parameter of the cognitive mirror and the virtual reflection.

2. The method of claim 1, wherein the controllable parameter of the cognitive mirror is one of a shape of the cognitive mirror, an angle of the cognitive mirror relative to the user.

3. The method of claim 1, wherein the controllable parameter of the cognitive mirror is one of a modification and augmentation of the virtual reflection.

4. The method of claim 3, wherein the augmentation of the virtual reflection includes displaying an alert.

5. The method of claim 3, wherein the modification of the virtual reflection includes zooming a portion of the virtual reflection, controlling a brightness of the virtual reflection, controlling a contrast of the virtual reflection, controlling a headlight dazzle for a vehicle imaged in the virtual reflection.

6. The method of claim 1, further comprising receiving, by a communication device, data indicative of a cognitive state of an operator in a vicinity of the user.

7. A computer program product for controlling a cognitive mirror apparatus, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:

capturing, by an imaging device of the cognitive mirror apparatus, a plurality of images;

capturing, by a sensor of the cognitive mirror apparatus, one or more parameters indicative of a cognitive state of a user including at least one of eye movement, facial expression, posture, and pulse;

receiving, by a controller of the cognitive mirror apparatus, the one or more parameters from the sensor;

mapping, by the controller, the one or more parameters indicative of the cognitive state of the user to a controllable parameter of a cognitive mirror of the cognitive mirror apparatus; and

displaying, by the cognitive mirror of the cognitive mirror apparatus, a virtual reflection comprising one or more of the plurality of images adjusted using the controllable parameter of the cognitive mirror, wherein the virtual reflection is iteratively updated by sampling the one or more parameters indicative of the cognitive state of the user and mapping sampled parameters indicative of the cognitive state of the user to adjust the controllable parameter of the cognitive mirror and the virtual reflection.

8. A method for controlling a cognitive mirror apparatus, the method comprising:

capturing, by an imaging device of the cognitive mirror apparatus, a video signal;

displaying, by a cognitive mirror of the cognitive mirror apparatus, a virtual reflection comprising the video signal;

determining, iteratively, by a controller of the cognitive mirror apparatus, a cognitive state of a user using one or more parameters of the user output by a sensor, wherein the one or more parameters include at least one of eye movement, facial expression, posture, and pulse;

determining, iteratively, by the controller of the cognitive mirror apparatus, a controllable parameter using the cognitive state of the user; and

displaying, iteratively, by the cognitive mirror of the cognitive mirror apparatus, an adjusted virtual reflection comprising the video signal, wherein the cognitive mirror is iteratively adjusted using the controllable parameter to display the adjusted virtual reflection.