Motion detecting web camera system
-
0Associated
Cases -
0Associated
Defendants -
0Accused
Products -
36Forward
Citations -
0
Petitions -
1
Assignment
First Claim
1. . A camera system for connection to a web server comprising:
- a video camera; and
a processor that periodically uploads images captured by the video camera in accordance with a plurality of motion detection algorithms, a first motion detection algorithm capturing a current image frame when a pixel comparison between successive image frames exceeds a predetermined threshold and a second motion detection algorithm capturing a stable frame after a certain duration has lapsed since the predetermined threshold has been exceeded.
1 Assignment
0 Petitions

Accused Products

Abstract
A camera system that includes a video camera and a processor, which periodically uploads images captured by the video camera to a web server in accordance with one of a plurality of motion detection algorithms. A first motion detection algorithm captures a current image frame when a pixel comparison between successive image frames exceeds a predetermined threshold.
51 Citations
View as Search Results
SYSTEMS AND METHODS FOR THE AUTOMATIC REGISTRATION OF DEVICES | ||
Patent #
US 20110050410A1
Filed 08/09/2010
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google LLC
|
CONFINED MOTION DETECTION FOR PAN-TILT CAMERAS EMPLOYING MOTION DETECTION AND AUTONOMOUS MOTION TRACKING | ||
Patent #
US 20110157358A1
Filed 02/12/2010
|
Current Assignee
Robert Bosch GmbH
|
Sponsoring Entity
Robert Bosch GmbH
|
Automated upload of content based on captured event | ||
Patent #
US 7,734,724 B2
Filed 02/02/2001
|
Current Assignee
Alarm.com Inc.
|
Sponsoring Entity
ATT Digital Life Inc.
|
AUTOMATED UPLOAD OF CONTENT BASED ON CAPTURED EVENT | ||
Patent #
US 20100208069A1
Filed 04/27/2010
|
Current Assignee
Alarm.com Inc.
|
Sponsoring Entity
Alarm.com Inc.
|
Systems and methods for the automatic registration of devices | ||
Patent #
US 7,796,023 B2
Filed 06/27/2007
|
Current Assignee
Google LLC
|
Sponsoring Entity
MANJOTRE DATA LIMITED LIABILITY COMPANY
|
METHOD AND APPARATUS FOR PROCESSING VIDEO FRAME | ||
Patent #
US 20090059002A1
Filed 05/19/2008
|
Current Assignee
LG Electronics Inc.
|
Sponsoring Entity
-
|
Systems and methods for the automatic registration of devices | ||
Patent #
US 20080030363A1
Filed 06/27/2007
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google LLC
|
Plant diagnosis support system and plant diagnosis support method | ||
Patent #
US 20060095231A1
Filed 10/24/2005
|
Current Assignee
Toshiba Corporation
|
Sponsoring Entity
Toshiba Corporation
|
Computer user detection apparatus and associated method | ||
Patent #
US 20060140452A1
Filed 12/14/2005
|
Current Assignee
Stmicroelectronics Limited
|
Sponsoring Entity
Stmicroelectronics Limited
|
Automated upload of content based on captured event | ||
Patent #
US 20030140090A1
Filed 02/02/2001
|
Current Assignee
Alarm.com Inc.
|
Sponsoring Entity
-
|
Systems and methods for the automatic registration of devices | ||
Patent #
US 8,723,664 B2
Filed 08/09/2010
|
Current Assignee
Google LLC
|
Sponsoring Entity
Nest Labs Incorporated
|
Automated upload of content based on captured event | ||
Patent #
US 8,860,804 B2
Filed 04/27/2010
|
Current Assignee
Alarm.com Inc.
|
Sponsoring Entity
ATT Digital Life Inc.
|
Method and apparatus for processing video frame | ||
Patent #
US 8,922,649 B2
Filed 05/19/2008
|
Current Assignee
LG Electronics Inc.
|
Sponsoring Entity
LG Electronics Inc.
|
Confined motion detection for pan-tilt cameras employing motion detection and autonomous motion tracking | ||
Patent #
US 9,041,800 B2
Filed 02/12/2010
|
Current Assignee
Robert Bosch GmbH
|
Sponsoring Entity
Robert Bosch GmbH
|
Node having components for performing functions and software for controlling the components if the node has been registered to a user account at a remote site | ||
Patent #
US 9,094,371 B2
Filed 09/09/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Methods and systems for installing a device at a location featuring a client application capable of displaying installation instructions via a client device | ||
Patent #
US 9,100,368 B2
Filed 09/09/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Systems and methods for the automatic registration of devices | ||
Patent #
US 9,118,626 B2
Filed 12/12/2013
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
System for remotely monitoring device to obtain information sensed by a device component featuring client application that displays virtual component corresponding to sensed information and remote site for facilitating communication between client application and device | ||
Patent #
US 9,137,108 B2
Filed 09/09/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
System for detecting trigger event at location and sending notification to remote user device featuring detecting device for detecting trigger event and remote site for receiving notification from detecting device and sending notification to client application of remote user device | ||
Patent #
US 9,172,742 B2
Filed 09/09/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
System for remotely controlling device of node featuring client application that displays virtual component corresponding to physical component of device and remote site located remote from node for sending control commands received from client application to node | ||
Patent #
US 9,172,606 B2
Filed 09/09/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Registration of nodes at remote sites | ||
Patent #
US 9,184,992 B2
Filed 09/23/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Method of registering a device at a remote site featuring a client application capable of establishing multiple wireless connections for transmitting registration messages between device and remote site | ||
Patent #
US 9,191,909 B2
Filed 09/10/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Method of registering a device at a remote site featuring a client application capable of detecting the device and transmitting registration messages between the device and the remote site | ||
Patent #
US 9,191,277 B2
Filed 09/09/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Data table at remote site having device identifier that identifies device at location remote from remote site, parameter setting for configuring device at location, and control setting for operation of device at location | ||
Patent #
US 9,203,695 B2
Filed 09/11/2014
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Node output facilitates communication with remote site | ||
Patent #
US 9,313,761 B2
Filed 09/16/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Node having functionality that is inoperable unless the node is registered to a user account at a remote site | ||
Patent #
US 9,332,057 B2
Filed 04/03/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Node unregisterable without user account at remote site | ||
Patent #
US 9,401,950 B2
Filed 09/17/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Remotely controlling node functionality | ||
Patent #
US 9,407,684 B2
Filed 09/16/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Remotely viewing image or video captured by node | ||
Patent #
US 9,407,685 B2
Filed 09/16/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Remote access to a node | ||
Patent #
US 9,413,810 B2
Filed 10/30/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Virtual representation systems and methods | ||
Patent #
US 9,473,559 B2
Filed 11/06/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Remotely controlling camera functionality | ||
Patent #
US 9,491,224 B2
Filed 09/17/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Provisioning remote access to a node | ||
Patent #
US 9,509,754 B2
Filed 10/30/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google Inc.
|
Functionality inoperable unless node registered at remote site | ||
Patent #
US 9,648,082 B2
Filed 10/30/2015
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google LLC
|
Configurable remote notification of detected events | ||
Patent #
US 10,122,784 B2
Filed 04/05/2017
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google LLC
|
Functionality inoperable unless node registered at remote site | ||
Patent #
US 10,284,624 B2
Filed 04/06/2018
|
Current Assignee
Google LLC
|
Sponsoring Entity
Google LLC
|
Method and system for camera with motion detection | ||
Patent #
US 5,602,585 A
Filed 12/22/1994
|
Current Assignee
Lucent Technologies Inc.
|
Sponsoring Entity
Lucent Technologies Inc.
|
Methods for remote monitoring and control of appliances over a computer network | ||
Patent #
US 20050198063A1
Filed 04/25/2005
|
Current Assignee
ATC- Advanced Technology Company LLC
|
Sponsoring Entity
ATC- Advanced Technology Company LLC
|
Surveillance system and method using personal computer | ||
Patent #
US 6,480,225 B1
Filed 02/25/1999
|
Current Assignee
Transpacific Avartar LLC
|
Sponsoring Entity
Samsung Electronics Co. Ltd.
|
Personal computer-based home security system | ||
Patent #
US 6,064,303 A
Filed 11/25/1997
|
Current Assignee
Mei California Inc.
|
Sponsoring Entity
Micro Electronics Incorporated
|
Versatile video transformation device | ||
Patent #
US 6,124,893 A
Filed 04/29/1998
|
Current Assignee
Stapleton John J.
|
Sponsoring Entity
Stapleton John J.
|
Apparatus and method for recapture of realtime events | ||
Patent #
US 6,163,338 A
Filed 08/07/1998
|
Current Assignee
Dan Johnson, Johnson Romer D.
|
Sponsoring Entity
Dan Johnson, Johnson Romer D.
|
System and method for a multiresolution transform of digital image information | ||
Patent #
US 5,946,417 A
Filed 09/10/1998
|
Current Assignee
Trustees Of Columbia University In The City Of New York
|
Sponsoring Entity
-
|
Video image compression and decompression | ||
Patent #
US 5,838,823 A
Filed 02/29/1996
|
Current Assignee
Electronic Arts Incorporated
|
Sponsoring Entity
Electronic Arts Incorporated
|
Method for compression and decompression of a video signal | ||
Patent #
US 5,835,147 A
Filed 11/15/1996
|
Current Assignee
Rafael - Armament Development Authority Ltd.
|
Sponsoring Entity
STATE OF ISRAELMINISTRY OF DEFENSE
|
Low cost joint HD/SD television decoder methods and apparatus | ||
Patent #
US 5,635,985 A
Filed 11/14/1994
|
Current Assignee
Hitachi America Limited
|
Sponsoring Entity
Hitachi America Limited
|
Screen overlay device for outputting cursor coordinates based on movement of a pointing device and an on-screen display relating to a menu and a method therefor | ||
Patent #
US 5,673,087 A
Filed 06/07/1995
|
Current Assignee
Samsung Electronics Co. Ltd.
|
Sponsoring Entity
Samsung Electronics Co. Ltd.
|
Event surveillance system | ||
Patent #
US 5,689,442 A
Filed 03/22/1995
|
Current Assignee
Witness Systems Incorporated
|
Sponsoring Entity
Witness Systems Incorporated
|
Terminal for digital network and method of controlling the same | ||
Patent #
US 5,418,548 A
Filed 10/29/1992
|
Current Assignee
Fujifilm Corporation
|
Sponsoring Entity
Fuji Photo Film Co Limited
|
Video trigger in a solid state motion analysis system | ||
Patent #
US 5,034,811 A
Filed 04/04/1990
|
Current Assignee
Ropintassco Holdings L.P.
|
Sponsoring Entity
Eastman Kodak Company
|
Perimeter surveillance system | ||
Patent #
US 4,249,207 A
Filed 11/26/1979
|
Current Assignee
Senstar Corporation
|
Sponsoring Entity
Computing Devices Company
|
7 Claims
- 1. . A camera system for connection to a web server comprising:
a video camera; and
a processor that periodically uploads images captured by the video camera in accordance with a plurality of motion detection algorithms, a first motion detection algorithm capturing a current image frame when a pixel comparison between successive image frames exceeds a predetermined threshold and a second motion detection algorithm capturing a stable frame after a certain duration has lapsed since the predetermined threshold has been exceeded. - View Dependent Claims (2, 4, 6)
- 3. . (Cancelled)
- 5. . (Cancelled)
- 7. .-20. (Cancelled)
1 Specification
This application is related to Application No. ______ entitled, “A Web Microphone System”, filed concurrently herewith, and application No. 09/124,179 entitled, “Digital Opaque Projector for Easy Creation and Capture of Presentation Material”, filed Jul. 28, 1998, which applications are assigned to the assignee of the present application.
The present invention relates generally to the field of video capture; more particularly, to video camera systems having information processing capabilities for uploading pictures to a web server.
A web camera (i.e., “webcam”) system consists of a video camera plus software that runs on a personal computer to periodically upload an image from the camera to a web page. The basic purpose of a web camera system is to post a reasonably live picture on a user-specified web page. Many webcam systems upload images on a periodic basis; for example, uploading an image once per hour.
Presently, there are two shareware products in existence that relate to web cameras: Ispy™ and Webcam32™. The Ispy webcam software functions to grab video images, save them as JPEG files, and then send the saved images automatically to a user-specified home page via the connection provided by the users'"'"' ISP. Ispy runs under Windows™95, Windows 98 and Windows NT 4.0; it also works with any video for Windows-compatible cameras and frame grabbers. Webcam32 is a Windows 95, Windows 98 and Windows NT application that allows video camera images to be displayed within a web page. Like Ispy, Webcam32 software is able to upload images to a web server to allow images to be obtained directly from the page. Both of these products include various simple image-processing features such as captioning of photos, day/time stamping, and text additions.
Webcam32™ software also offers rudimentary motion detection, which is of primary use in security surveillance applications. For example, the Webcam32™ software allows images to be uploaded when, say, 25% of the pixels in the image frame change from one image frame to the next. Although this motion-detecting feature of the software product is useful in limited types of motion detection applications (e.g., security surveillance), it is not useful for different applications. For example, if the web camera system is intended for use in observing and recording wildlife activity, then this type of rudimentary motion detection does not work well.
Another problem with today'"'"'s webcam systems is the conflict between the desire to minimize the number of times the web camera contacts the ISP and the need to capture “interesting” pictures (i.e., those containing certain kinds of motion). Most security surveillance type of web camera systems have a low threshold that results in the taking of many pictures whenever activity is detected. Uploading many pictures onto a web page presents a serious bandwidth problem.
Furthermore, existing products such as Ispy and Webcam32 only provide the ability to capture images on a given schedule, e.g., once per hour, or whenever motion occurs, regardless of how often. If set to capture on a predetermined schedule, images that may be of interest to the user may end up being ignored. On the other hand, if the software is set to upload a video image whenever motion is detected, scenes containing frequent motion can tie up the user'"'"'s phone lines.
Thus, there is a need for a web camera system that overcomes the problems inherent in the prior art.
The present invention is a camera system for connection to a web server. The system comprises a video camera and a processor that periodically uploads images captured by the video camera in accordance with one of a plurality of motion detection algorithms. A first motion detection algorithm captures a current image frame when a pixel comparison between successive image frames exceeds a predetermined threshold.
The present invention will be understood more fully from the detailed description which follows and from the accompanying drawings, which however, should not be taken to limit the invention to the specific embodiments shown, but are for explanation and understanding only.
A web camera system that operates in accordance with one of a plurality of motion detection algorithms is described. In the following description, numerous specific details are set forth, such as specific operating modes, procedures, circuit elements, etc., in order to provide a thorough understanding of the invention. It will be obvious, however, to one skilled in the art, that these specific details may not be needed to practice the present invention.
The state-of-the-art of web camera systems is such that there exists a conflict between the desire to minimize the number of times the web camera system dials up the Internet service provider and the desire to capture “interesting” pictures (e.g., those containing certain particular kinds of motion). As previously discussed, existing software products utilized to capture video images permit some rudimentary motion detection. These programs are utilized in applications concerned primarily with uploading images the instant motion is detected. While such programs are suitable for use in applications such as security surveillance systems, they suffer problems when used in different applications, e.g., observation of wildlife activity.
If a motion detecting feature is included in the web camera system, the taking of a picture may be triggered each time movement above a certain threshold is detected. In this case, when the number of pixels between two successive pictures changes (above a predetermined threshold) a new picture is captured and uploaded to the user'"'"'s specified web site. By way of example, frame 22 of
Another concern relates to movement of the bird when it takes flight to leave the bird feeder station. Existing web camera systems with motion detecting features will trigger on this type of motion. Unfortunately, the last video image captured as a result of this type of motion is an empty bird feeder station, as represented by frame 23. In other words, the most recently captured image for uploading to the user'"'"'s web site is that of the empty bird feeder, rather than the desired image of wildlife activity.
The present invention solves the problem of motion detection and timed update by uploading one image each predetermined interval—selecting the best candidate video image that occurred during any given interval. The camera system includes a video camera coupled to a processor that operates in accordance with one of a plurality of motion detection algorithms to select an image for uploading to the user'"'"'s web site.
The basic algorithm is as follows. Motion is first detected by performing a pixel comparison between successive image frames. When the pixel comparison between a current image frame and a previous image frame exceeds a predetermined threshold level, software running on the processor saves the current picture as a candidate for uploading. A simple frame grabber technology may be utilized for capture of the video image.
The processor may be programmed to periodically upload the current or last candidate image. For example, a typical web camera system may operate by uploading the last candidate image once every hour. If no motion is detected in the past hour, there are two options: either no uploading of any image, or upload a current image captured by the camera regardless of whether motion is detected.
With reference to
A second type of motion detection mode of operation is referred to as “stable-change” detection. The stable-change mode of motion detection is designed to capture persistent changes in a scene, while ignoring relatively simple motions. For example, the stable-change mode of operation is useful in video conferencing applications where the video camera is aimed at a desk or whiteboard where a speaker is placing written subject matter or other objects in front of the camera to facilitate discussion. In such applications, it is useful to capture the notes written on a board, or otherwise presented in front of the camera, while ignoring extraneous motion such as writing on the board, finger pointing, etc.
The stable-change mode of operation is aimed at detecting stable changes to a particular scene and operates in accordance with an algorithm that captures an image frame a certain time period following a last detected motion event. The time duration may be programmable, timed, or fixed depending on what is being viewed and what is to be captured. In the video conferencing application discussed above, software running on the processor operates to capture a video image frame and copy or upload it to remote sites whenever a new writing (or other object for presentation) is placed in front of the video camera. The stable-change mode of operation ignores constant ongoing activity in the field of view.
As can be seen in
The third mode of motion detection operation is referred to in this application as “novel” motion detection. The novel motion detection mode of operation solves the problem that arises in certain applications such as observation of wildlife activity wherein the motion of a bird arriving at a feeder is very similar to the motion of the bird departing from the feeder. A webcam system operating in accordance with only a basic motion detection algorithm—which simply saves the most recent image with motion—cannot distinguish between these two types of events. In other words, the basic motion detection algorithm captures the image of the just vacated bird feeder for uploading to the web server, rather than the picture of the bird that left, simply because it triggers on the last motion detected.
In solving this problem, the novel motion detection algorithm compares an image that contains motion against the most recent stable image, as described above. Images that are not substantially different from the stable image frame are ignored.
In this mode, each time motion is detected, the current image is captured into a circular buffer. In other words, in the novel motion detection mode of operation, pictures are captured into a buffer at times other than the last stable frame. The detection of a last stable frame triggers the uploading of an image from the circular buffer that was captured some predetermined time prior to the triggering event. In the bird feeder example, the uploaded image might be an image frame captured several seconds prior to the last detected motion, e.g., an image of the bird prior to leaving.
In one embodiment of the present invention the selected image represents a candidate picture that may be uploaded to a web server at a predetermined interval. Generally speaking, the user may set the interval for uploading the last candidate picture, as well as the particular mode of motion detection to be utilized.
When basic motion is detected, the pixel comparison causes a motion signal to be asserted by logic circuitry in the processor. This is illustrated in
Both the current image frame and the previous image frame may be held in separate buffers after being captured by the video camera. In this particular mode of operation, a circular buffer may be utilized as a candidate buffer for holding the most recent images captured responsive to the motion signal. The storing of the image frames in the circular buffer is represented in
Step 36 is a determination of whether a stable image frame is detected. If not, the algorithm returns to the beginning step 31. On the other hand, if a stable frame is detected, then one of the stored frames is selected for uploading to a web server. The particular frame that may be chosen is the frame that occurred a predetermined time prior to the detection of a stable frame. For example, in the bird feeder example, it is useful to select an image that was captured several seconds prior to the last detected motion of the bird leaving the feeder.