Method for open loop camera control using a motion model to control camera movement

• US 5,872,594 A
• Filed: 08/24/1995
• Issued: 02/16/1999
• Est. Priority Date: 09/20/1994
• Status: Expired due to Term

• Current Assignee: Paul A. Thompson
• Original Assignee: Paul A. Thompson
• Inventors: Thompson, Paul A.
• Primary Examiner(s): Garber, Wendy
• Assistant Examiner(s): NGUYEN, LUONG TRUNG
• Application Number:
  US08/519,138
• Time in Patent Office: 1,272 Days
• Field of Search: 348/39, 348/36, 348/143, 348/152, 348/153, 348/159, 348/218, 348/211, 348/213, 348/187, 348/138, 396/94, 340/825.49, 364/150, 364/149, 364/474.24, 364/560, 364/561
• US Class Current: 348/211.6
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A camera control system incorporating a data processor is provided which uses a coordinate system based on CADD drawings and motion models of the cameras to effect open loop camera control of various cameras of the system. Various input and pointing devices are used to communicate with the system, and camera video is processed by the data processor.

Claims

1. A method implemented by a data processor for controlling at least one movable camera without closed loop feedback information, said camera positioned to surveil an area and provide a view of a portion of said area as an output, and at least one monitor, and comprising the steps of:

1) overlaying said area with a coordinate system so that every point in said area is located by a unique set of coordinates,

2) developing a motion model for said camera wherein rates of each motion parameter of the camera are found and stored in memory,

3) referencing an orientation of said camera to at least one set of coordinates in said coordinate system,

4) selecting a point in said area to be viewed by said camera,

5) calculating camera movement using said rates developed by said motion model and a referenced said orientation of said camera to direct said camera to said point,

6) moving said camera according to a calculated said camera movement,

7) coupling said output from said camera to said monitor to display said point on said monitor.

2. A method as set forth in claim 1 wherein said motion model of said camera is developed by steps comprising:

1) recording a panoramic view of said area,

2) driving said camera between a plurality of randomly selected views within said panoramic view,

3) comparing each of said randomly selected views with portions of said panoramic view to determine location of each of said randomly selected views in said panoramic view,

4) recording time intervals needed to drive said camera between said randomly selected views.

3. A method as set forth in claim 1 further comprising the step of utilizing a CADD drawing as said coordinate system.

4. A method as set forth in claim 3 further comprising the steps of identifying entities of interest in said CADD drawing, and extracting coordinates of each of said entities of interest from said CADD drawing for driving a camera to view a selected one of said entities of interest.

5. A method as set forth in claim 4 further comprising the step of developing an entity data file wherein extracted said coordinates of each of said entities of interest are associated with an identification attribute for identifying a particular entity of interest and an area reference attribute for identifying a particular area within which the entity of interest resides.

6. A method as set forth in claim 5 further comprising the step of associating with each said extracted set of coordinates of said entity of interest height information relating to a distance from a floor a view of the entity of interest is centered, and distance from said camera to said entity of interest for focusing a lens of said camera on said entity of interest.

7. A method as set forth in claim 1 further comprising the step of generating a representation of said view in said area as projected on a floor of said area, said representation synchronized with camera movement and adjustable in size to reflect an actual field of view of said camera.

8. A method as set forth in claim 1 wherein said step 5) thereof further comprises the step of touching a point in a graphical display of said area on a touch screen monitor to select said point to be viewed.

10. A method as set forth in claim 7 wherein at least one said motion model is determined by steps comprising:

1) recording a panoramic view from said camera,

2) randomly selecting a plurality of views from said camera,

3) comparing each said random view with said panoramic view and determining a location of said random view within said panoramic view,

4) using motor ON time intervals between said random views together with motor motion to determine motor backlash, acceleration, deceleration, and maximum speed.

9. A process for open loop camera control implemented by a data processor wherein cameras are moved relative to at least one CADD drawing comprising the steps of:

1) determining a motion model for each of said cameras,

2) referencing each said camera to a respective said CADD drawing,

3) referencing objects of interest to said CADD drawing,

4) calculating camera movement using parameters of said motion model and coordinates of a selected one of said objects of interest.

11. An open loop method implemented by a data processor for controlling a plurality of movable surveillance cameras comprising the steps of:

1) determining rate of operation of each type camera movement for each camera of said cameras,

2) referencing areas viewable by each said movable camera with at least a planar reference wherein coordinates of any point in said planar reference, and thus any point in said areas, may be precisely located,

3) selecting a point of interest to be viewed in said areas,

4) selecting at least one camera of said cameras to view said point of interest,

5) using a determined said rate of operation for each said type camera movement, and coordinates of said point of interest as referenced by said planar reference, to calculate time intervals of movement for each said type camera movement necessary to move said one camera from its current viewing location to said coordinates of said point of interest so that said one camera views said point of interest.

12. A method as set forth in claim 11 wherein a plurality of predetermined points of interest are viewed in a predetermined sequence, and comprising the steps of:

1) selecting a first predetermined point of interest in said sequence,

2) moving a camera of said cameras to view said first point of interest,

3) pausing at said first predetermined point of interest for a selected interval,

4) selecting successive points of interest in said predetermined sequence, and moving at least one camera of said cameras to view each of said predetermined points of interest, and

5) pausing at each of said predetermined points of interest for a predetermined interval.

13. A method as set forth in claim 12 wherein camera movement between each of said predetermined points of interest comprises the step of continuously adjusting a rate of chance of azimuth and elevation angles of said one camera so that a view from said one camera moves along a predetermined path between each of said predetermined points of interest at a constant speed so that said path is viewable.

14. A method as set forth in claim 12 further comprising the steps of:

1) converting said coordinates of each of said predetermined points of interest to azimuth and elevation angles of said one camera,

2) independently driving azimuth and elevation mechanisms of said one camera to said azimuth and elevation angles to view each of said points of interest in said predetermined sequence.

15. A method as set forth in claim 11 wherein said step 5) thereof further comprises the steps of:

1) generating a moving destination that moves relative to said areas,

2) continuously calculating and adjusting each said type camera movement to drive said one camera to track said moving destination.

16. A method as set forth in claim 11 wherein said step 5) thereof further comprises the steps of:

1) converting said coordinates of said point of interest to azimuth and elevation angles,

2) moving said one camera to said azimuth and elevation angles independently of one another to view said point of interest.

17. A method as set forth in claim 11 further comprising the steps of:

1) coupling a plurality of alarm means to said data processor, each said alarm means adapted to provide an alarm signal to said data processor responsive to an alarm condition,

2) interrupting operation of said data processor responsive to reception of a said alarm signal by said data processor,

3) providing an indication of said alarm signal,

4) entering alarm data related to said alarm signal into a log file,

5) moving at least one said camera in accordance with said step

     5) of claim 11 to view a said area from which said alarm signal originates.

18. A method as set forth in claim 11 further comprising the step of displaying a graphical view of a floor plan of an area viewable by at least one said camera on the same monitor with video from said camera.

19. A method as set forth in claim 11 further comprising the steps of:

1) locating a nearest hardware preset view to said point of interest,

2) moving said one camera to said hardware preset view,

3) after said hardware preset view is acquired, moving said one camera in accordance with said step

     5) of claim 11 to said point of interest.

20. A method as set forth in claim 19 further comprising the step of using azimuth and elevation angles of said hardware preset view to calibrate position of said one camera when said hardware preset view is acquired.

21. A method as set forth in claim 11 further comprising the steps of:

1) after initialization, and during operation of a camera, acquiring a reference view having known azimuth and elevation angles with respect to a said camera observing said reference view,

2) removing alignment errors of said camera after said reference view is acquired.

22. A method as set forth in claim 21 further comprising the step of moving said camera to a parking view after said alignment errors of said camera are removed.

23. A method as set forth in claim 21 wherein said step 1) thereof further comprises the step of including an identifiable point source of light at known azimuth and elevation angles in said reference view for locating said reference view.

24. A method as set forth in claim 11 wherein each said rate of operation includes the step of calculating each said type camera movement in sets of small, discrete increments of time, each of said sets representative of a total length of time calculated for a discrete said type camera movement.

25. A method as set forth in claim 24 wherein during each of said small increments of time,checking, for each of said cameras, a plurality of status flags each indicating a said type camera movement, and where a status flag of said status flags for a said type camera movement is set,decrementing a total number of said increments of time by one,terminating said type camera movement and resetting said status flag after said total number of said increments of time expire.

26. A method as set forth in claim 11 further comprising the step of appending a height coordinate to coordinates of selected points of interest, so that when a selected point of interest is selected for viewing, a respective said camera is moved to image a selected height over said selected point of interest.

27. A method as set forth in claim 26 further comprising the step of utilizing coordinates from a CADD drawing as said planar reference.