Image recognition facilitated movable barrier operations method and apparatus

• US 7,345,574 B2
• Filed: 01/29/2004
• Issued: 03/18/2008
• Est. Priority Date: 01/29/2004
• Status: Active Grant

• Current Assignee: The Chamberlain Group LLC
• Original Assignee: The Chamberlain Group, Inc. (The Chamberlain Group LLC)
• Inventors: Fitzgibbon, James J.
• Primary Examiner(s): Zimmerman; Brian
• Assistant Examiner(s): AU, SCOTT D
• Application Number:
  US10/767,184
• Publication Number:
  US 20050168321A1
• Time in Patent Office: 1,510 Days
• Field of Search: 340/5.53, 340/5.7, 340/5.64, 340/5.52, 340/5.71, 382/115
• US Class Current: 340/5.71
• CPC Class Codes: G07C 9/00 Individual registration on entry or exit
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition

Abstract

A movable barrier operator system (10) having a movable barrier operator (11) and a wireless remote control (13) also has an automatic image recognizer (14) operably coupled to at least one of the preceding elements. In a preferred embodiment this automatic image recognizer comprises one or more image capture device (15). So configured, automated operational control decisions can be predicated, at least in part, on image-based information regarding a likely relative position of the wireless remote control with respect to the movable barrier operator.

Claims

1. An apparatus comprising:

a movable barrier operator;

a movable barrier operator wireless remote control;

an automatic image recognizer operably coupled to at least one of the movable barrier operator and the movable barrier operator wireless remote control, the automatic image recognizer obtaining at least one image representative of an environment of a vehicle, the at least one image indicative of whether the vehicle is present in the environment relative to the moveable barrier operator, and the moveable barrier operator responsive to whether the vehicle is present relative to the moveable barrier operator.

2. The apparatus of claim 1 wherein the automatic image recognizer operably couples to the movable barrier operator.

3. The apparatus of claim 1 wherein the automatic image recognizer operably couples to the movable barrier operator wireless remote control.

4. The apparatus of claim 1 wherein the automatic image recognizer comprises an image capture device which captures an image from the vehicle.

5. The apparatus of claim 4 wherein the image capture device comprises a digital image capture device.

6. The apparatus of claim 4 wherein the image capture device is integrally disposed with respect to the movable barrier operator wireless remote control.

7. The apparatus of claim 4 wherein the image capture device is remotely disposed with respect to the movable barrier operator wireless remote control.

8. The apparatus of claim 7 wherein the image capture device is operably coupled to the movable barrier operator wireless remote control by a wireless link.

9. The apparatus of claim 4 wherein the image capture device is responsive to movement instructions as sourced by the movable barrier operator.

10. The apparatus of claim 4 wherein the automatic image recognizer comprises a plurality of image capture devices.

11. The apparatus of claim 10 wherein at least one of the plurality of image capture devices is operably coupled to the movable barrier operator and another of the plurality of image capture devices is operably coupled to the movable barrier operator wireless remote control.

12. The apparatus of claim 10 wherein at least two of the plurality of image capture devices are each operably coupled to the movable barrier operator.

13. The apparatus of claim 1 wherein the image capture device is remotely disposed from the vehicle.

14. The apparatus of claim 13 wherein the image capture device is operably coupled to the movable barrier operator by a wireless link.

15. The apparatus of claim 13 wherein the image capture device is operably coupled to the movable barrier operator by a wireline link.

16. The apparatus of claim 13 wherein the image capture device comprises a stationary platform.

17. The apparatus of claim 13 wherein the automatic image recognizer comprises a plurality of image capture devices and at least two of the plurality of image capture devices are each operably coupled to the movable barrier operator wireless remote control.

18. The apparatus of claim 1 wherein the automatic image recognizer further comprises image recognition means for recognizing a substantially current image as matching information that corresponds to a predetermined image standard by at least a predetermined threshold.

19. The apparatus of claim 18 wherein the automatic image recognizer further comprises a user adjustment interface such that a user can modify the predetermined threshold.

20. The apparatus of claim 1 wherein at least one of the movable barrier operator and the movable barrier operator wireless remote control have an image capture user interface such that a user can cause capture of at least one image to be used to facilitate provision of the predetermined image standard.

21. The apparatus of claim 1 wherein at least one of the movable barrier operator and the movable barrier operator wireless remote control further comprises a memory that contains information corresponding to at least one predetermined image standard.

22. The apparatus of claim 1 wherein the automatic image recognizer comprises a visible light automatic image recognizer.

23. The apparatus of claim 1 wherein the automatic image recognizer comprises a non-visible light automatic image recognizer.

34. The method of claim 23 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises:

providing first information that corresponds to at least a first predetermined image standard regarding the environment of the vehicle with respect to the movable barrier operator; and

providing second information that corresponds to at least a second predetermined image standard regarding the environment of a second vehicle with respect to the movable barrier operator.

35. The method of claim 34 and further comprising correlating the first information with a first identifier and correlating the second information with a second identifier.

24. A method comprising:

providing information that corresponds to at least one predetermined image standard representative of an environment of a vehicle with respect to a movable barrier operator, the predetermined image standard indicative of whether the vehicle is present relative to the moveable barrier operator;

providing information that corresponds to a substantially current image;

determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal; and

in response to the match detected signal, automatically initiating an action at at least one of a movable barrier operator and a movable barrier operator wireless remote control.

25. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises capturing an image and providing the image to the movable barrier operator.

26. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises capturing an image and providing the image to the movable barrier operator wireless remote control.

27. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises providing information that corresponds to a plurality of predetermined image standards regarding the environment of the vehicle with respect to a movable barrier operator.

28. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises providing information that corresponds to at least one predetermined image standard regarding a view of the vehicle in the environment.

29. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises providing information that corresponds to at least one predetermined image standard regarding a view from a vantage point of the vehicle.

30. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises storing the information at the movable barrier operator.

31. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises storing the information at the movable barrier operator wireless remote control.

32. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises modifying an original image regarding the environment of the vehicle with respect to the movable barrier operator.

33. The method of claim 32 wherein modifying an original image regarding the environment of the vehicle with respect to the movable barrier operator further comprises modifying the original image to simulate a specific environmental context and the position of the vehicle in that context.

36. The method of claim 24 wherein the vehicle comprises a terrestrial vehicle.

37. The method of claim 24 wherein providing information that corresponds to a substantially current image further comprises capturing the substantially current image using an image capture device that is operably coupled to the movable barrier operator.

38. The method of claim 24 wherein providing information that corresponds to a substantially current image further comprises capturing the substantially current image using an image capture device that is operably coupled to the movable barrier operator wireless remote control.

39. The method of claim 24 wherein determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal further comprises determining the predetermined threshold as a function, at least in part, of a user manipulable threshold adjustment setting.

40. The method of claim 24 wherein determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal further comprises determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined percentage to provide a match detected signal.

41. The method of claim 24 wherein determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal further comprises:

comparing information regarding a first substantially current image with information regarding a second substantially current image to determine whether the vehicle and movable barrier operator presently appear to be drawing closer to one another.

42. The method of claim 24 wherein providing information that corresponds to at least one predetermined image standard regarding the environment of the vehicle with respect to a movable barrier operator further comprises:

detecting user assertion of a wireless remote control transmit button;

responding to the assertion by capturing an image to provide a captured image; and

using the captured image to provide the information that corresponds to the at least one predetermined image standard.

43. The method of claim 24 wherein automatically initiating an action further comprises causing the movable barrier operator wireless remote control to transmit a signal.

44. The method of claim 43 wherein causing the movable barrier operator wireless remote control to transmit a signal further comprises causing the movable barrier operator wireless remote control to transmit a command signal intended for the movable barrier operator.

45. The method of claim 24 wherein automatically initiating an action further comprises:

at the movable barrier operator wireless remote control;

transmitting a first signal;

monitoring for a predetermined response from the movable barrier operator; and

upon detecting the predetermined response, transmitting a second signal.

46. The method of claim 45 wherein monitoring for a predetermined response from the movable barrier operator further comprises using an image capture device to monitor for the predetermined response.

47. The method of claim 45 wherein transmitting a second signal further comprises transmitting a movable barrier movement command signal.

48. The method of claim 24 wherein automatically initiating an action further comprises causing the movable barrier operator to automatically initiate movement of a movable barrier.

49. The method of claim 24 wherein automatically initiating an action further comprises causing the movable barrier operator to transmit a signal to the movable barrier operator wireless remote control.

50. The method of claim 49 wherein the signal comprises status information.

51. The method of claim 24 wherein automatically initiating an action further comprises causing the movable barrier operator to automatically operate least a first light in a predetermined manner.

52. The method of claim 24 and further comprising, in the absence of the match detected signal but in the presence of a wireless movable barrier movement remote control signal to the movable barrier operator, automatically storing a substantially current image of the movable object.

53. The method of claim 24 and further comprising determining a time to next provide information that corresponds to a next substantially current image.

54. The method of claim 53 wherein determining a time to next provide information that corresponds to a next substantially current image further comprises determining the time as a function, at least in part, of similarity between at least two previous images.

55. An apparatus comprising:

a movable barrier operator;

a movable barrier operator wireless remote control;

an automatic image recognizer operably coupled to at least one of the movable barrier operator and the movable barrier operator wireless remote control, the automatic image recognizer obtaining at least one image of a vehicle, the at least one image evidencing the presence of the vehicle relative to the moveable barrier operator, the moveable barrier operator responsive to the presence of the vehicle.

56. The apparatus of claim 55 wherein the automatic image recognizer operably couples to the movable barrier operator.

57. The apparatus of claim 55 wherein the automatic image recognizer operably couples to the movable barrier operator wireless remote control.

58. The apparatus of claim 57 wherein at least one of the movable barrier operator and the movable barrier operator wireless remote control further comprises a memory that contains information corresponding to at least one predetermined image standard.

59. The apparatus of claim 55 wherein the automatic image recognizer comprises an image capture device.

60. The apparatus of claim 59 wherein the image capture device comprises a digital image capture device.

61. The apparatus of claim 59 wherein the image capture device is remotely disposed with respect to the movable barrier operator.

62. The apparatus of claim 61 wherein the image capture device is operably coupled to the movable barrier operator by a wireless link.

63. The apparatus of claim 61 wherein the image capture device is operably coupled to the movable barrier operator by a wireline link.

64. The apparatus of claim 59 wherein the image capture device is integrally disposed with respect to the movable barrier operator wireless remote control.

65. The apparatus of claim 59 wherein the image capture device is remotely disposed with respect to the movable barrier operator wireless remote control.

66. The apparatus of claim 65 wherein the image capture device is operably coupled to the movable barrier operator wireless remote control by a wireless link.

67. The apparatus of claim 59 wherein the image capture device comprises a stationary platform.

68. The apparatus of claim 59 wherein the image capture device comprises a movable platform.

69. The apparatus of claim 68 wherein the image capture device is responsive to movement instructions as sourced by the movable barrier operator.

70. The apparatus of claim 59 wherein the automatic image recognizer comprises a plurality of image capture devices.

71. The apparatus of claim 70 wherein at least one of the plurality of image capture devices is operably coupled to the movable barrier operator and another of the plurality of image capture devices is operably coupled to a movable barrier operator wireless remote control.

72. The apparatus of claim 70 wherein at least two of the plurality of image capture devices are each operably coupled to the movable barrier operator.

73. The apparatus of claim 70 wherein at least two of the plurality of image capture devices are each operably coupled to a movable barrier operator wireless remote control.

74. The apparatus of claim 55 wherein the automatic image recognizer further comprises image recognition means for recognizing a substantially current image as matching information that corresponds to a predetermined image standard by at least a predetermined threshold.

75. The apparatus of claim 74 wherein the automatic image recognizer further comprises a user adjustment interface such that a user can modify the predetermined threshold.

76. The apparatus of claim 55 wherein at least one of the movable barrier operator and the movable barrier operator wireless remote control have an image capture user interface such that a user can cause capture of at least one image to be used to facilitate provision of the predetermined image standard.

77. The apparatus of claim 55 wherein the automatic image recognizer comprises a visible light automatic image recognizer.

78. The apparatus of claim 55 wherein the automatic image recognizer comprises a non-visible light automatic image recognizer.

79. A method comprising:

providing information that corresponds to at least one predetermined image standard regarding a presence of a vehicle with respect to a movable barrier operator, the predetermined image standard indicative of whether the vehicle is present relative to the moveable barrier operator;

providing information that corresponds to a substantially current image;

determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal; and

in response to the match detected signal, automatically initiating an action at least one of a movable barrier operator and a movable barrier operator wireless remote control.

80. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises capturing an image and providing the image to the movable barrier operator.

81. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises capturing an image and providing the image to the movable barrier operator wireless remote control.

82. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises providing information that corresponds to a plurality of predetermined image standards regarding at least one position of the vehicle with respect to a movable barrier operator.

83. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises providing information that corresponds to at least one predetermined image standard regarding a view of the vehicle.

84. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises providing information that corresponds to at least one predetermined image standard regarding a view from a vantage point of the vehicle.

85. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises storing the information at the movable barrier operator.

86. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises storing the information at the movable barrier operator wireless remote control.

87. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises modifying an original image regarding the presence of the vehicle with respect to the movable barrier operator.

88. The method of claim 87 wherein modifying an original image regarding the presence of the vehicle with respect to the movable barrier operator further comprises modifying the original image to simulate a specific environmental context of the vehicle relative to the moveable barrier operator.

89. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises:

providing first information that corresponds to at least a first predetermined image standard regarding the presence of the vehicle with respect to the movable barrier operator; and

providing second information that corresponds to at least a second predetermined image standard regarding the presence of a second vehicle with respect to the movable barrier operator.

90. The method of claim 89 and further comprising correlating the first information with a first identifier and correlating the second information with a second identifier.

91. The method of claim 79 wherein the movable object comprises a terrestrial vehicle.

92. The method of claim 79 wherein providing information that corresponds to a substantially current image further comprises capturing the substantially current image using an image capture device that is operably coupled to the movable barrier operator.

93. The method of claim 79 wherein providing information that corresponds to a substantially current image further comprises capturing the substantially current image using an image capture device that is operably coupled to the movable barrier operator wireless remote control.

94. The method of claim 79 wherein determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal further comprises determining the predetermined threshold as a function, at least in part, of a user manipulable threshold adjustment setting.

95. The method of claim 79 wherein determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal further comprises determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined percentage to provide a match detected signal.

96. The method of claim 79 wherein determining whether at least some information in the substantially current image matches information in the at least one predetermined image standard by at least a predetermined threshold to provide a match detected signal further comprises:

comparing information regarding a first substantially current image with information regarding a second substantially current image to determine whether the movable object and movable barrier operator presently appear to be drawing closer to one another.

97. The method of claim 79 wherein providing information that corresponds to at least one predetermined image standard regarding the presence of the vehicle with respect to a movable barrier operator further comprises:

detecting user assertion of a wireless remote control transmit button;

responding to the assertion by capturing an image to provide a captured image; and

using the captured image to provide the information that corresponds to the at least one predetermined image standard.

98. The method of claim 79 wherein automatically initiating an action further comprises causing the movable barrier operator wireless remote control to transmit a signal.

99. The method of claim 98 wherein causing the movable barrier operator wireless remote control to transmit a signal further comprises causing the movable barrier operator wireless remote control to transmit a command signal intended for the movable barrier operator.

100. The method of claim 79 wherein automatically initiating an action further comprises:

at the movable barrier operator wireless remote control;

transmitting a first signal;

monitoring for a predetermined response from the movable barrier operator; and

upon detecting the predetermined response, transmitting a second signal.

101. The method of claim 100 wherein monitoring for a predetermined response from the movable barrier operator further comprises using an image capture device to monitor for the predetermined response.

102. The method of claim 100 wherein transmitting a second signal further comprises transmitting a movable barrier movement command signal.

103. The method of claim 79 wherein automatically initiating an action further comprises causing the movable barrier operator to automatically initiate movement of a movable barrier.

104. The method of claim 79 wherein automatically initiating an action further comprises causing the movable barrier operator to transmit a signal to the movable barrier operator wireless remote control.

105. The method of claim 104 wherein the signal comprises status information.

106. The method of claim 79 wherein automatically initiating an action further comprises causing the movable barrier operator to automatically operate least a first light in a predetermined manner.

107. The method of claim 79 and further comprising, in the absence of the match detected signal but in the presence of a wireless movable barrier movement remote control signal to the movable barrier operator, automatically storing a substantially current image of the movable object.

108. The method of claim 79 and further comprising determining a time to next provide information that corresponds to a next substantially current image.

109. The method of claim 108 wherein determining a time to next provide information that corresponds to a next substantially current image further comprises determining the time as a function, at least in part, of similarity between at least two previous images.