Apparatus and method for controlling configuration of video camera

• US 6,680,746 B2
• Filed: 11/28/1995
• Issued: 01/20/2004
• Est. Priority Date: 11/28/1994
• Status: Expired due to Term

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Oya, Takashi, Kawai, Tomoaki, Tsujimura, Kazuko
• Primary Examiner(s): Vu, Ngoc-Yen, VU, NGOC YEN T
• Application Number:
  US08/563,703
• Publication Number:
  US 20020067412A1
• Time in Patent Office: 2,975 Days
• Field of Search: H04/N.718, H04/N.947, H04/N.5232, H04/N.5262, 348/20, 348/135, 348/139, 348/141, 348/143, 348/159, 348/207, 348/211, 348/212, 348/213, 348/218, 348/222, 348/239, 348/333, 348/334
• US Class Current: 348/211.9
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A camera control system for displaying a video image inputted from a plurality of cameras, wherein in order to easily control each camera, a map showing positions of cameras is prepared. Along with the map, icons indicating the positions of cameras are displayed on the map so that the directions of the cameras can be identified on the map. An operator is able to select a camera referring to the map and see the video image of the selected camera. When each of the cameras is to be operated, an operator uses a pointing device to operate an icon for a camera on the map. In this camera control system, a camera corresponding to each icon can be controlled for zooming, panning, tilting and focusing by operating the icon for each camera. An operator may delete, add or move the icon for a camera according to an actual structure of the camera system.

Claims

1. A controller for controlling an image input unit, comprising:

image display means for displaying an image from the image input unit;

map display means for displaying a map including a target image input region of the image input unit, and displaying, on the map, the input unit as a predetermined symbol in correspondence with a position of the image input unit;

operation means for permitting a user to directly point at the symbol on the map for changing a display state of the symbol and to drag the symbol on the map, by using a pointing device;

command generation means for generating a command for controlling the image input unit in accordance with a result of the operation of the symbol by said operation means; and

output means for outputting a control command to the input image unit.

2. The controller according to claim 1, wherein said output means controls a pan angle, a tilt angle, a zoom ratio, and a focal length of the selected input unit.

3. The controller according to claim 2, wherein when said operation means changes a direction of the symbol, the pan angle of the selected input unit is controlled by said control means in correspondence with the direction of the symbol.

4. The controller according to claim 2, wherein when said operation means changes the tilt angle of the selected input unit corresponding to the symbol, a control command for controlling the tilt angle of the selected input unit is outputted by said output means.

5. The controller according to claim 2, wherein when said operation means changes the zoom ratio of the selected input unit corresponding to the symbol, a control command for controlling the zoom ratio of the selected input unit is outputted by said output means.

6. The controller according to claim 2, wherein when said operation means changes the focal length of the selected input unit corresponding to the symbol, a command for controlling the focal length of the selected input unit is outputted by said output means.

7. The controller according to claim 2, wherein said operation means switches an operation mode among a mode for changing the focal length of the input unit, a mode for changing the tilt angle of the input unit, and a mode for changing the zoom ratio of the input unit, and allows a desired operation in the selected mode.

8. The controller according to claim 2, wherein said map display means displays a state of each of the at least one input unit.

9. The controller according to claim 8, wherein said map display means displays a maximum field angle and a maximum pan angle of each of the input units using a predetermined pattern having the symbol corresponding to the input unit as a center.

10. The controller according to claim 9, wherein the predetermined pattern is a fan shape having the symbol as the center.

11. The controller according to claim 1, wherein said map display means displays the symbol of the selected input unit to be identifiable from the symbol of the non-selected input unit.

12. The controller according to claim 11 , further comprising selection means selects an input unit corresponding to the symbol closest to a point designated on the map.

13. The controller according to the claim 12, further comprising state display means for displaying a state of the input unit selected by selection means.

14. The controller according to claim 13, wherein said state display means displays the position, pan angle, tilt angle, and zoom ratio of the selected input unit.

15. The controller according to claim 1, further comprising arrangement operation means for changing the map display by said map display means in correspondence with a state of an arrangement of the controller.

16. The controller according to claim 15, wherein said arrangement operation means performs addition, deletion, and a change of position of the symbols corresponding to the input units in correspondence with the input units included in said image input means.

17. The controller according to claim 1, further comprising connection means for interconnecting said controller with another controller via a network.

18. The controller according to claim 1, wherein said operation means changes the state of the symbol without using the image input unit.

19. The controller according to claim 18, wherein said command generation means generates the command for controlling the image input unit so as to correspond to the state of the input unit with the state of the symbol changed by said operation means.

20. A controller for controlling an image input operation, comprising:

image input means including at least one externally controllable input unit;

selection means for selecting one from the at least one input unit, and receiving an image input from the selected input unit;

image display means for displaying the image input from the input unit selected by said selection means;

map display means for displaying a map indicating a target image input region of said image input means, and displaying, on the map, each of the at least one input unit as a predetermined symbol in correspondence with a position of the input unit;

operation means for dragging the symbol on a display screen in accordance with an operation by a user, and when said operation means changes a direction of the symbol, a pan angle of the input unit is controlled in correspondence with the direction of the symbol, said operation means comprises coordinate indication means for indicating a desired coordinate position on the display screen of said map display means and determines a direction connecting the symbol corresponding to the selected input unit and the desired coordinate position indicated by said coordinate indication means as a change direction of the symbol, and said map display means displays the changed direction using a straight line; and

output means for outputting a control command to the selected input unit so as to control the selected input unit corresponding to the operated symbol in accordance with an operation result of the symbol by said operation means, said output means controls the pan angle, a tilt angle, a zoom ratio, and a focal length of the input unit.

21. A controller for controlling an image input operation, comprising:

image input means including at least one externally controllable input unit;

selection means for selecting one from the at least one input unit, and receiving an image input from the selected input unit;

image display means for displaying the image input from the input unit selected by said selection means;

map display means for displaying a map indicating a target image input region of said image input means, and displaying, on the map, each of the at least one input unit as a predetermined symbol in correspondence with a position of the input unit;

operation means for dragging the symbol on a display screen in accordance with an operation by a user, when said operation means changes a tilt angle of the input unit corresponding to the symbol, said operation means comprises coordinate indication means for indicating a desired coordinate position on the display screen of said map display means and determines the changed tilt angle of the selected input unit corresponding to the symbol in correspondence with the position of the desired coordinate position indicated by said coordinate indication means with respect to a position of the symbol corresponding to the selected input unit; and

output means for outputting a control command to the selected input unit so as to control the selected input unit corresponding to the operated symbol in accordance with an operation result of the symbol by said operation means, said output means controls a pan angle, a zoom ratio, and a focal length of the selected input unit.

22. A controller for controlling an image input operation, comprising:

image input means including at least one externally controllable input unit;

selection means for selecting one from the at least one input unit, and receiving an image input from the selected input unit;

image display means for displaying the image input from the input unit selected by said selection means;

map display means for displaying a map indicating a target image input region of said image input means, and displaying, on the map, each of the at least one input unit as a predetermined symbol in correspondence with a position of the input unit;

operation means for dragging the symbol on a display screen in accordance with an operation by a user, when said operation means changes a zoom ratio of the input unit corresponding to the symbol, a control command for controlling the zoom ratio of the input unit is outputted, said operation means comprises coordinate, indication means for indicting a desired coordinate position on the display screen of said map display means, said coordinate indication means designates an angle defined between two half lines having the symbol corresponding to the selected input unit as a central line, and the changed zoom ratio of the input unit corresponding to the symbol is determined in correspondence with the designated angle; and

output means for outputting a control command to the selected input unit so as to control the selected input unit corresponding to the operated symbol in accordance with an operation result of the symbol by said operation means, said output means controls a pan angle, a tilt angle, the zoom ratio, and a focal length of the input unit.

23. A controller for controlling an image input operation, comprising:

image input means including at least one externally controllable input unit;

selection means for selecting one from the at least one input unit, and receiving an image input from the selected input unit;

image display means for displaying the image input from the input unit selected by said selection means;

map display means for displaying a map indicating a target image input region of said image input means, and displaying, on the map, each of the at least one input unit as a predetermined symbol in correspondence with a position of the input unit;

operation means for dragging the symbol on a display screen in accordance with an operation by a user, when said operation means changes a focal position of the selected input unit corresponding to the symbol, a command for controlling the focal position of the selected input unit is outputted, said operation means comprises coordinate indication means for indicating a desired coordinate position on the display screen of said map display means and determines a distance from the symbol corresponding to the selected input unit to the desired coordinate position indicated by said coordinate indication means as the changed focal position and

output means for outputting a control command to the selected input unit so as to control the selected input unit corresponding to the operated symbol in accordance with an operation result of the symbol by said operation means, said output means controls a pan angle, a tilt angle, a zoom ratio, and the focal length of the selected input unit.

24. A camera controller comprising:

image display means for displaying an input image from a camera;

map display means for displaying a map of a region where the cameras are disposed, and displaying, on the map, the camera as a predetermined symbol in correspondence with a position of the camera;

operation means for permitting a user to directly point at the symbol on the map for changing a display state of the symbol and to drag the symbol on the map, by using a pointing device;

command generation means for generating a command for controlling the camera in accordance with a result of the operation of the symbol by said operation means; and

output means for outputting a control command to the camera.

25. The controller according to claim 24, wherein said output means outputs a command for controlling a pan angle, a tilt angle, a zoom ratio, and a focal length of the camera.

26. The controller according to claim 24, further comprising means for maintaining the symbol corresponding to the camera on the map displayed by said map display means in correspondence with a state of an arrangement of said controller.

27. The controller according to claim 24, wherein said operation means changes the state of the symbol without using the camera.

28. The controller according to claim 27, wherein said command generation means generates the command for controlling the camera so as to correspond to the state of the camera with the state of the symbol changed by said operation means.

29. A camera controller comprising:

at least one externally controllable camera;

selection means for selecting one of the cameras and receiving an image input from the selected camera;

image display means for displaying the image input from the camera selected by said selection means;

map display means for displaying a map of a region where the cameras are disposed, and displaying, on the map, each of the cameras as a predetermined symbol in correspondence with a position of the camera, said map display means displays, on the map, a current field angle and a maximum pan angle of each of the at least one camera using a fan shape having the symbol corresponding to the camera as a center;

operation means for operating the symbol on a display screen; and

control means for controlling the camera corresponding the operated symbol in accordance with an operation result of the symbol.

30. A camera control method for controlling a camera, comprising the steps of:

displaying a map, and displaying a symbol of a camera on the map in correspondence with a position of the camera;

displaying an input image input from the camera;

permitting a user to directly point at the symbol on the map for changing a display state of the symbol and to drag the symbol on the map, by using a pointing device; and

changing a state of the camera including a pan angle of the camera in accordance with a result of the direct operation of the symbol on the map.

31. The method according to claim 30, further comprising, before the change step, the step of setting an operation mode, and wherein the change step includes the step of changing one of a focal length, a zoom ratio, and a tilt angle in correspondence with the operation mode.

32. The method according to claim 30, wherein the change step includes the step of changing a state of the camera in correspondence with an operation of the symbol of the camera by coordinate input means.

33. The method according to claim 30, wherein a focal length and the pan angle are set upon selection of the symbol in the selection step.

34. The method according to claim 30, wherein the display step includes the step of displaying the symbol of each of the cameras in correspondence with control characteristics of the camera corresponding to the symbol.

35. The method according to claim 34, wherein the display step includes the step of displaying the symbol of each of the cameras together with a maximum pan angle and a current field angle of the camera corresponding to the symbol if the control characteristics of the camera allow rotation and zoom operations, and displaying the symbol of each of the cameras together with the current field angle if the control characteristics of the camera do not allow rotation and zoom operations.

36. The controller according to claim 30, wherein said change step changes a state of the camera so as to correspond the state of the camera is changed with the state of the symbol changed by the dragging operation.

37. The method according to claim 30, further comprising the steps of:

setting a direction of the symbol of the camera as an initial sensing direction of the camera, and

storing information about a map edited and the direction of the symbol of the camera as a map edited file.

38. The method according to claim 37, wherein the initial sensing direction of the camera is set by dragging the symbol of the camera.

39. A camera control method for controlling a remote camera, comprising:

the display step of displaying a map, and displaying symbols of cameras on the map;

the selection step of selecting a desired symbol from the symbols;

the step of displaying an image input from the camera corresponding to the symbol selected in the selection step, the symbol selected in the selection step is displayed together with an auxiliary line used for operating a state of the camera corresponding to the symbol, and the state is changed by operating the auxiliary line by coordinate input means; and

the change step of changing a state including a pan angle of the camera selected in the selection step.

40. A camera control method for controlling a remote camera, comprising:

the display step of displaying a map, and displaying symbols of cameras on the map;

the selection step of selecting a desired symbol from the symbols;

the step of displaying an image input from the camera corresponding to the symbol selected in the selection step, the symbol selected in the selection step is displayed together with an auxiliary line used for operating a state of the camera corresponding to the symbol, and the state is changed by operating the auxiliary line by coordinate input means, the auxiliary line includes zoom lines representing a tilt angle and a tilt line indicating a tilt angle and

the change step of changing a state including a pan angle of the camera selected in the selection step.

41. A camera controller comprising:

image display means for displaying the image input from a camera;

symbol display means for displaying the camera as a predetermined symbol and current field angle and maximum pan angle of the camera using a fan shape having the symbol corresponding to the camera as a center;

operation means for operating the symbol on a display screen; and

control means for controlling the camera corresponding to the operated symbol in accordance with an operation result of the symbol.

42. A camera controlling method comprising the steps of:

displaying the image input from a camera;

displaying the camera as a predetermined symbol and current field angle and maximum pan angle of the camera using a fan shape having the symbol corresponding to the camera as a center;

operating the symbol on a display screen; and

controlling the camera corresponding to the operated symbol in accordance with an operation result of the symbol.

43. A controller for controlling an image input unit, comprising:

a display control device arranged to display an image from the image input unit and a symbol which indicates a position of the image input unit on a map;

a control device arranged to permit a user to directly point at the symbol for changing a display state of the symbol and to drag the symbol on the map, by using a pointing device; and

an output device arranged to output a control command, which is generated on the basis of changing a display state of the symbol, for controlling the image input unit.

44. A controller according to claim 43, wherein the control command is a command for controlling an image pickup direction of the image input unit.

45. A controller according to claim 43, wherein the control command is a command for controlling a zoom of the image input unit.

46. A controller according to claim 43, wherein the control command is a command for controlling a focus of the image input unit.

47. The controller according to claim 43, wherein said control device sets a direction of the symbol of the image input unit as an initial sensing direction of the image input unit, and

further comprising a storing device that stores information about a map edited and the direction of the symbol of the image input unit as a map edited file.

48. The controller according to claim 47, wherein said control device sets the initial sensing direction of the image input unit by dragging the symbol of the image input unit.

49. The controller according to claim 45, wherein said control device sets a direction of the symbol of the image input unit as an initial sensing direction of the image input unit, and

further comprising a storing device that stores information about a map edited and the direction of the symbol of the image input unit as a map edited file.

50. The controller according to claim 49, wherein said control device sets the initial sensing direction of the image input unit by dragging the symbol of the image input unit.

51. A camera control apparatus for controlling a remote camera, comprising:

a display unit for displaying a map, and displaying symbols of cameras on the map;

a selection unit for permitting a user select a desired symbol from the symbols;

a display control unit for displaying an image input from the camera corresponding to the symbol selected by said selection unit, the symbol selected by said selection unit is displayed together with an auxiliary line used for operating a state of the camera corresponding to the symbol, and the state is changed by operating the auxiliary line by a coordinate input unit; and

a change unit for permitting a user to change a state including a pan angle of the camera selected by said selection unit.

52. The apparatus according to claim 51, wherein said auxiliary line is a line which indicates photographing optical axis of camera.

53. The apparatus to claim 51, wherein said display control unit changes the state of the symbol in accordance with the operation of the auxiliary line.

54. A computer program product comprising a computer readable medium having computer program code for controlling a remote camera, said product comprising:

displaying process procedure code for displaying a map, and displaying symbols of cameras on the map;

selecting process procedure code for permitting a user to select a desired symbol from the symbols;

display controlling process procedure code for displaying an image input from the camera corresponding to the symbol selected by said selecting process procedure code, the symbol selected by said selecting process procedure code is displayed together with an auxiliary line used for operating a state of the camera corresponding to the symbol, and the state is changed by operating the auxiliary line by a coordinate input process; and

changing a process procedure code for permitting a user to change a state including a pan angle of the camera selected by said selecting process procedure code.

55. The computer program product according to claim 54, wherein said auxiliary line is a line which indicates photographing optical axis of the camera.

56. The computer program product according to claim 54, wherein said display controlling process procedure code changes the state of the symbol in accordance with the operation of the auxiliary line.

57. A control method for controlling an image input unit, comprising:

a displaying step of displaying an image from the image input unit and a symbol which indicates a position of the image input unit on a map;

a pointing step of permitting a user to directly point at the symbol for changing a display state of the symbol and to drag the symbol on the map, by using a pointing device; and

an outputting step of outputting a control command, which is generated on the basis of changing a display state of the symbol, for controlling the image input unit.

58. A control method according to claim 57, wherein the control command is a command for controlling an image pickup direction of the image input unit.

59. A control method according to claim 57, wherein the control command is a command for controlling a zoom of the image input unit.

60. A control method according to claim 57, wherein the control command is a command for controlling a focus of the image input unit.

61. A computer program product comprising a computer readable medium having a computer program code for controlling an image input unit, said product comprising:

displaying process procedure code for displaying an image from the image input unit and a symbol which indicates a position of the image input unit on a map;

pointing process procedure code for permitting a user to directly point at the symbol for changing a display state of the symbol and to drag the symbol on the map, by using a pointing device; and

outputting process procedure code for outputting a control command, which is generated on the basis of changing a display state of the symbol, for controlling the image input unit.

62. A computer program according to claim 61, wherein the control command is a command for controlling an image pickup direction of the image input unit.

63. A computer program product according to claim 61, wherein the control command is a command for controlling a zoom of the image input unit.

64. A computer program product according to claim 61, wherein the control command is a command for controlling a focus of the image input unit.

65. A controller for controlling an image input unit, comprising:

a display control device arranged to display an image from the image input unit and a symbol which indicates a position and state of the image input unit on a map;

a control device arranged to permit a user to directly point and drag the symbol for changing a display state of the symbol on the map, by using a pointing device; and

an output device arranged to output a control command, related to a change of the display state of the symbol, for controlling the image input unit.

66. A controller according to claim 65, wherein the control command is a command for controlling an image pickup direction of the image input unit.

67. A controller according to claim 65, wherein the control command is a command for controlling a zoom of the image input unit.

68. A controller according to claim 65, wherein the control command is a command for controlling a focus of the image input unit.

69. A control method for controlling an image input unit, comprising:

a displaying step of displaying an image from the image input unit and a symbol which indicates a position and a state of the image input unit on a map;

a pointing step of permitting a user to directly point and drag the symbol for changing a display state of the symbol on the map, by using a pointing device; and

an outputting step of outputting a control command, related to a change of the display state of the symbol, for controlling the image input unit.

70. A control method according to claim 69, wherein the control command is a command for controlling an image pickup direction of the image input unit.

71. A control method according to claim 69, wherein the control command is a command for controlling a zoom of the image input unit.

72. A control method according to claim 69, wherein the control command is a command for controlling a focus of the image input unit.

73. A computer program product comprising a computer readable medium having a computer program code for controlling an image input unit, said product comprising:

displaying process procedure code for displaying an image from the image input unit and a symbol which indicates a position and state of the image input unit on a map;

pointing process procedure code for permitting a user to directly point and drag the symbol for changing a display state of the symbol on the map, by using a pointing device; and

outputting process procedure code for outputting a control command, related to a change of the display state of the symbol, for controlling the image input unit.

74. A computer program according to claim 73, wherein the control command is a command for controlling an image pickup direction of the image input unit.

75. A computer program according to claim 73, wherein the control command is a command for controlling a zoom of the image input unit.

76. A computer program according to claim 73, wherein the control command is a command for controlling a focus of the image input unit.