Tracking object of interest in an omnidirectional video
First Claim
1. A device comprising:
- at least one processor and at least one memory including computer program code,a display element coupled to the processor, anda user input element coupled to the processor;
wherein the computer program code and the at least one memory are configured, with the at least one processor, to cause the device to;
play an omnidirectional video comprising a series of image frames,display a portion of the image frames of the played omnidirectional video on the display element,receive a user input from the user input element, the user input comprising selection of an object of interest in the displayed portion of at least one image frame of the played omnidirectional video,identify the object of interest in at least one image frame of the played omnidirectional video based on the user input,track the selected object of interest in consequent image frames of the played omnidirectional video,adjust the displayed portion of the consequent image frames of the played omnidirectional video so that the tracked object of interest remains in the displayed portion,detect that the tracked selected object of interest is absent from a predefined number of image frames, andstop tracking the selected object of interest.
2 Assignments
0 Petitions
Accused Products
Abstract
A device is presented. The device comprises: at least one processor and at least one memory including computer program code, a display element coupled to the processor, and a user input element coupled to the processor. The computer program code and the at least one memory are configured, with the at least one processor, to cause the device to: play an omnidirectional video comprising a series of image frames, display a portion of the image frames of the played omnidirectional video on the display element, receive a user input from the user input element, the user input comprising selection of an object of interest in the displayed portion of at least one image frame of the played omnidirectional video, identify the object of interest in at least one image frame of the played omnidirectional video based on the user input, track the selected object of interest in consequent image frames of the played omnidirectional video, and adjust the displayed portion of the consequent image frames of the played omnidirectional video so that the tracked object of interest remains in the displayed portion. A method and method are also presented.
93 Citations
20 Claims
-
1. A device comprising:
-
at least one processor and at least one memory including computer program code, a display element coupled to the processor, and a user input element coupled to the processor; wherein the computer program code and the at least one memory are configured, with the at least one processor, to cause the device to; play an omnidirectional video comprising a series of image frames, display a portion of the image frames of the played omnidirectional video on the display element, receive a user input from the user input element, the user input comprising selection of an object of interest in the displayed portion of at least one image frame of the played omnidirectional video, identify the object of interest in at least one image frame of the played omnidirectional video based on the user input, track the selected object of interest in consequent image frames of the played omnidirectional video, adjust the displayed portion of the consequent image frames of the played omnidirectional video so that the tracked object of interest remains in the displayed portion, detect that the tracked selected object of interest is absent from a predefined number of image frames, and stop tracking the selected object of interest. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 19)
-
-
12. A method comprising:
-
playing an omnidirectional video comprising a series of image frames, displaying a portion of image frames of the played omnidirectional video on a display element, receiving a user input comprising selection of an object of interest in the displayed portion of at least one image frame of the played omnidirectional video, identifying the object of interest in at least one image frame of the played omnidirectional video based on the user input, tracking the selected object of interest in consequent image frames of the played omnidirectional video, adjusting the displayed portion of the consequent image frames of the played omnidirectional video so that the tracked object of interest remains in the displayed portion, detecting that the tracked selected object of interest is absent from a predefined number of image frames, and stopping tracking the selected object of interest. - View Dependent Claims (13, 14, 15, 16, 17, 20)
-
-
18. A device comprising
at least one processor and at least one memory including computer program code, a user input element coupled to the processor, a camera coupled to the processor and configured to capture an omnidirectional video comprising a series of image frames, the camera having an image-capture field of view of at least 180 degrees in at least one of a horizontal direction and a vertical direction; - wherein
the computer program code and the at least one memory are configured, with the at least one processor, to cause the device to receive the omnidirectional video captured by the camera, receive a user input from the user input unit, the user input comprising selection of an object of interest in at least one image frame of the received omnidirectional video, identify the object of interest in at least one image frame of the received omnidirectional video based on the user input, track the selected object of interest in consequent image frames of the received omnidirectional video, assign a portion of the consequent image frames of the received omnidirectional video so that the tracked object of interest remains in the assigned portion of the image frames, record metadata in the memory, the metadata comprising an indication of the assigned portion of the image frames of the received omnidirectional video, detect that the tracked selected object of interest is absent from a predefined number of image frames, stop tracking the selected object of interest, and resume tracking of the selected object of interest upon detecting the selected object of interest in a predetermined number of consequent image frames.
- wherein
Specification