Video searching for filtered and tagged motion

• US 10,299,017 B2
• Filed: 09/14/2015
• Issued: 05/21/2019
• Est. Priority Date: 09/14/2015
• Status: Active Grant

• Current Assignee: Logitech Europe S A (Logitech International SA)
• Original Assignee: Logitech Europe S A (Logitech International SA)
• Inventors: Borel, Vincent, Standridge, Aaron, Nater, Fabian, Grabner, Helmut
• Primary Examiner(s): Camargo, Marly S
• Application Number:
  US14/853,989
• Publication Number:
  US 20170078767A1
• Time in Patent Office: 1,345 Days
• Field of Search: 348 97, 348154, 348155, 3482081, 3482082, 3482084, 34820813, 34820816, 34821112, 3482312, 348169, 348239, 348352, 34820814, 348 23, 348 12, 34823199, 382107, 382103, 382236, 382224, 382291, 715254, 715716, 715719, 715721, 715723, 715756, 715972, 715700, 715722, 709224, 709FOR 101, 725105, 725132, 725 12, 396153
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 20/47 Detecting features for summarising video content
• CPC Class Codes: G06V 20/48 Matching video sequences
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

In one embodiment, captured video summaries are tagged with metadata so the videos can be easily searched. The videos are classified into different scenes, depending on the type of action in the video, so searching can be based on the type of scene. In one embodiment, tags are provided for moving objects or people. The type of object that is moving is tagged (car, ball, person, pet, etc.). Video search results are ranked based on the weighting of the video events or video summaries. The video summary weighting focuses on important events, with multiple videos/images over a period of time condensed into a short summary video. This creates a weighted video summary with different time-lapse speeds that focuses on important events.

Claims

1. A method of searching video from a camera, comprising:

detecting motion using a processor in the camera;

determining, using the processor, whether the motion is significant, and filtering out video without significant motion;

storing video with significant motion in a memory of the camera;

transmitting the video in the memory to a remote computing device using a transmitter in the camera;

organizing the video into separate video events;

creating, with the remote computing device, a plurality of summary videos from multiple video events provided by the camera;

tagging each summary video with a plurality of tags corresponding to the events in the video summary;

in response to search terms entered by a user, matching the search terms to the tags;

displaying indicators of video summaries with a best match to the search terms, ranked in order of best match; and

providing, with the search results, indications of videos without tags corresponding to the search terms, but that are proximate in time to videos with the tags.

2. The method of claim 1 wherein creating a plurality of video summaries comprises:

creating a time lapse video having significant motion video events and no significant motion images over a period of time;

wherein the time lapse video is created by allocating less time to the images with no significant motion; and

allocating more time to videos with significant motion.

3. The method of claim 1 further comprising ranking video search results based on a weighting of the video summaries.

4. The method of claim 1 wherein organizing the video into separate video events comprises filtering the video to eliminate portions of the video with motion not relevant to a video event.

5. A method of searching video from a camera, comprising:

detecting motion using a processor in the camera;

determining, using the processor, whether the motion is significant, and filtering out video without significant motion;

storing video with significant motion in a memory of the camera;

transmitting the video in the memory to a remote computing device using a transmitter in the camera;

organizing the video into separate video events;

creating, with the remote computing device, a plurality of summary videos from multiple video events provided by the camera;

tagging each summary video with a plurality of tags corresponding to the events in the video summary;

in response to search terms entered by a user, matching the search terms to the tags;

displaying indicators of video summaries with a best match to the search terms, ranked in order of best match; and

providing, with the search results, indications of videos without tags corresponding to the search terms, but with other tags that correspond to non-searched tags in the videos in the search results.

6. The method of claim 5 wherein the search terms include at least one of time, duration of video, people in the video, objects in the video and camera location.

7. The method of claim 5 further comprising:

weighting each video event based on the significance of the tags; and

displaying indicators of video events with a best match to the search terms, ranked in order of best match and the weighting of the video events.

8. The method of claim 5 wherein the video events are tagged based on a scene in the video event, wherein the scene depends on the type of action in the video event.

9. A method of searching video from a camera, comprising:

detecting motion using a processor in the camera;

determining, using the processor, whether the motion is significant, and filtering out video without significant motion;

storing video with significant motion in a memory of the camera;

transmitting the video in the memory to a remote computing device using a transmitter in the camera;

organizing the video into separate video events;

tagging each video event with a plurality of tags corresponding to at least two of time, duration of video, people in the video, objects in the video and camera location;

weighting each video event based on the significance of the tags;

in response to search terms entered by a user, matching the search terms to the tags;

displaying indicators of video events with a best match to the search terms, ranked in order of best match and the weighting of the video events; and

providing, with the search results, indications of videos without tags corresponding to the search terms, but that are one of proximate in time to videos with the tags and have other tags that correspond to non-searched tags in the videos in the search results.

10. A system for searching video from a camera, comprising:

a processor in the camera configured to detect motion;

the processor further configured to determine whether the motion is significant, and filtering out video without significant motion;

a memory in the camera for storing the video;

a transmitter in the camera configured to transmit the video in the memory;

a remote computing device configured to receive the transmitted video;

the remote computing device being configured to organize the video into separate video events;

the remote computing device being configured to tag each video event with a plurality of tags corresponding to at least two of time, duration of video, people in the video, objects in the video and camera location;

the remote computing device being configured to weight each video event based on the significance of the tags;

the remote computing device being configured to, in response to search terms entered by a user, match the search terms to the tags;

the remote computing device being configured to display indicators of video events with a best match to the search terms, ranked in order of best match and the weighting of the video events; and

the remote computing device is further configured to provide, with the search results, indications of videos without tags corresponding to the search terms, but with other tags that correspond to non-searched tags in the videos in the search results.

11. The system of claim 10 wherein the remote computing device is a server.

12. The system of claim 10 wherein the remote computing device is a smart phone, configured to communicate with the camera using a server over the Internet.

13. The system of claim 10 wherein the remote computing device is further configured to create a summary video by:

creating a time lapse video having significant motion video events and no significant motion images over a period of time;

wherein the time lapse video is created by allocating less time to the images with no significant motion; and

allocating more time to videos with significant motion.

14. The system of claim 10 wherein the remote computing device is the combination of a server and a smartphone.