Alarm masking based on gaze in video management system

• US 10,643,443 B2
• Filed: 12/30/2016
• Issued: 05/05/2020
• Est. Priority Date: 12/30/2016
• Status: Active Grant

• Current Assignee: Axis AB (Canon Inc.)
• Original Assignee: Axis AB (Canon Inc.)
• Inventors: Ardo, Bjorn, Pihl, Fredrik
• Primary Examiner(s): Anyikire, Chikaodili E
• Application Number:
  US15/395,403
• Publication Number:
  US 20180190090A1
• Time in Patent Office: 1,222 Days
• Field of Search: None
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G08B 13/19669 Event triggers storage or change of storage policy
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19691 Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound

Abstract

A method and system for monitoring video data based on gaze is disclosed. The method may include receiving a video stream generated by a camera and presenting the received video stream on a display. The method may further include receiving a notification signal triggered by an event and determining that the video stream is associated with the notification signal. The method may further include detecting a gaze point of an operator viewing the display and determining at least one parameter associated with the gaze point. The method may include controlling a state of an alarm associated with the notification signal based upon the at least one parameter associated with the gaze point.

Claims

1. A method for monitoring video data based on gaze sensing, comprising:

receiving a video stream generated by a camera;

presenting the received video stream on a display;

receiving a notification signal triggered by an event;

determining that the video stream is associated with the notification signal;

determining a gaze point located on the display of an operator viewing the display;

determining at least one parameter associated with the gaze point located on the display; and

controlling a state of an alarm associated with the notification signal based upon the at least one parameter associated with the gaze point on the located on the display,

wherein controlling the state of the alarm includes masking the alarm by preventing the alarm from activating based upon the at least one parameter associated with the gaze point located on the display.

2. The method of claim 1, wherein receiving a notification signal triggered by an event further comprises:

receiving the notification signal from a sensor that is independent from the camera, wherein the sensor includes at least one of a proximity sensor, an intrusion sensor, a smoke sensor, a heat sensor, a pressure sensor, a motion sensor, a radar sensor, or a radiation sensor.

3. The method of claim 1, wherein receiving a notification signal triggered by an event further comprises:

detecting an object in the received video stream to determine whether to generate the notification based on the event, wherein the event includes at least one of movement of the object, the object entering a field of view of the camera, an object leaving the field of view of the camera, recognizing that the object belongs to a particular class of physical objects, or recognizing that the object is a face of a particular person.

4. The method of claim 3, further comprising:

determining that the gaze point located on the display tracks the object in the video stream for a period of time exceeding a predetermined threshold.

5. The method of claim 1, wherein determining at least one parameter associated with the gaze point located on the display further comprises:

determining that a location of the gaze point on the display coincides with the presented video stream for a period of time.

6. The method of claim 5, wherein controlling a state of an alarm associated with the notification signal further comprises deactivating a currently active alarm.

7. The method of claim 5, wherein controlling the state of the alarm associated with the notification signal further comprises automatically acknowledging the alarm on behalf of the operator.

8. The method of claim 5, wherein controlling the state of the alarm associated with the notification signal further comprises changing a visual presentation or an audio presentation of the alarm to be less conspicuous.

9. The method of claim 5, further comprising:

initiating automatically a recording of the received video stream in response to determining that a location of the gaze point on the display coincides with the presented video stream for a period of time.

10. The method of claim 9, wherein receiving a notification signal triggered by an event further comprises:

detecting an object in the received video stream to determine whether to generate the notification based on the event, wherein the event includes at least one of movement of the object, the object entering a field of view of the camera, an object leaving the field of view of the camera, recognizing that the object belongs to a particular class of physical objects, or recognizing that the object is a face of a particular person; and

determining that the gaze point located on the display tracks the object in the video stream for a period of time exceeding a predetermined threshold.

11. The method of claim 1, wherein masking the alarm by preventing the alarm from activating based upon the at least one parameter associated with the gaze point located on the display includes:

preventing the alarm from generating a sound or a visual indication based upon the at least one parameter associated with the gaze point located on the display.

12. A system for monitoring video data based on gaze sensing, comprising:

a receiver to receive a video stream generated by a camera and to receive a notification signal triggered by an event;

a display to present the received video stream on the display;

a processor to determine that the video stream is associated with the notification signal,

wherein the processor is configured to receive, from an eye tracker configured to detect a gaze point located on the display of an operator viewing the display, at least one parameter associated with the gaze point located on the display,

wherein the processor is further configured to control a state of an alarm associated with the notification signal based upon the at least one parameter associated with the gaze point located on the display, and

wherein the processor is configured to control the state of the alarm by masking the alarm by preventing the alarm from activating based upon the at least one parameter associated with the gaze point located on the display.

13. The system of claim 12, wherein the notification signal was generated by a sensor that is independent from the camera, wherein the system includes at least one of a proximity sensor, an intrusion sensor, a smoke sensor, a heat sensor, a pressure sensor, a motion sensor, a radar sensor, or a radiation sensor.

14. The system of claim 12, further comprising:

the camera, wherein the camera is configured to detect an object in the received video stream to determine whether to generate the notification based on the event, wherein the event includes at least one of movement of the object, the object entering a field of view of the camera, an object leaving the field of view of the camera, recognizing that the object belongs to a particular class of physical objects, or recognizing that the object is a face of a particular person.

15. The system of claim 14, further comprising:

the eye tracker, wherein the eye tracker is configured to determine that the gaze point located on the display tracks the object in the video stream for a period of time exceeding a predetermined threshold.

16. The system of claim 12, further comprising:

the eye tracker, wherein the eye tracker is configured to determine that a location of the gaze point on the display coincides with the presented video stream for a period of time.

17. The system of claim 16, wherein the processor is configured to control the state of the alarm by deactivating a currently active alarm.

18. The system of claim 16, wherein the processor is configured to control the state of the alarm by automatically acknowledging the alarm on behalf of the operator.

19. The system of claim 16, wherein the processor is configured to control the state of the alarm by changing a visual presentation or an audio presentation of the alarm to be less conspicuous.

20. The system of claim 16, wherein the processor is configured to initiate an automatic recording of the received video stream in response to determining that the location of the gaze point on the display coincides with the presented video stream for a period of time.

21. The system of claim 20, further comprising:

the camera, wherein the camera is configured to detect an object in the received video stream to determine whether to generate the notification based on the event, wherein the event includes at least one of movement of the object, the object entering a field of view of the camera, an object leaving the field of view of the camera, recognizing that the object belongs to a particular class of physical objects, or recognizing that the object is a face of a particular person; and

the eye tracker, wherein the eye tracker is configured to determine that the gaze point located on the display tracks the object in the video stream for a period of time exceeding a predetermined threshold.

22. The system of claim 12, wherein the processor is configured to control the state of the alarm by masking the alarm by preventing the alarm from generating a sound or a visual indication based upon the at least one parameter associated with the gaze point located on the display.