AUTOMATIC MOTION TRACKING, EVENT DETECTION AND VIDEO IMAGE CAPTURE AND TAGGING

• US 20110228098A1
• Filed: 02/10/2011
• Published: 09/22/2011
• Est. Priority Date: 02/10/2010
• Status: Abandoned Application

• Current Assignee: Brian Lamb, Vladimir Tetelbaum
• Original Assignee: Brian Lamb, Vladimir Tetelbaum
• Inventors: Tetelbaum, Vladimir, Lamb, Brian
• Application Number:
  US13/025,114
• Publication Number:
  US 20110228098A1
• Time in Patent Office: Days
• US Class Current: 348/164
• CPC Class Codes: G01S 17/66 Tracking systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders

Abstract

A method is provided to track an object, the method comprising: directing a video imager to perform image recognition to recognize a feature of the object within an imager field of view and to determine a position of the feature within the field of view; using an IR sensor to determine a position of an infrared (IR) transmitter; and automatically adjusting orientation of the imager as a function of the position of the recognized feature within the field of view and the determined position of the IR transmitter to follow movement of the object.

Claims

1. A method to track an object comprising:

directing a video imager to perform image recognition to recognize a feature of the object within an imager field of view and to determine a position of the feature within the field of view;

transmitting an infrared (IR) signal by an IR transmitter disposed upon the object;

using an IR sensor to determine a position of the infrared (IR) transmitter; and

automatically adjusting orientation of the imager based upon the position of the recognized feature within the field of view and the determined position of the IR transmitter to follow movement of the object.

2. The method of claim 1,

wherein automatically adjusting includes adjusting as a function of an offset between a location of a portion of the object that includes the recognized feature and a location on a portion of the object upon which the IR transmitter is disposed.

3. The method of claim 1,

wherein the IR sensor is disposed adjacent to the imager.

4. The method of claim 1,

wherein the video imager is mounted upon a servo system;

and

wherein automatically adjusting orientation of the imager includes using the servo system to adjust the orientation of the imager.

5. The method of claim 1,

wherein automatically adjusting orientation of the imager includes cropping an image within the imager field of view.

6. The method of claim 1,

wherein automatically adjusting orientation of the imager includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function of the position of the recognized feature within the field of view and the determined position of the IR transmitter.

7. The method of claim 1,

wherein the video imager is mounted upon a servo system;

wherein automatically adjusting orientation of the imager includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function of the position of the recognized feature within the field of view and the determined position of the IR transmitter; and

wherein automatically adjusting orientation of the imager further includes using the servo system to adjust the orientation of the imager based upon the determined final position of the object.

8. The method of claim 1

using first sensor data generated by a motion sensor to detect position of the object;

wherein automatically adjusting orientation of the imager includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function of the position of the recognized feature within the field of view and the determined position of the IR transmitter and the first sensor data.

9. The method of claim 8,

wherein the first sensor is mounted upon the object.

10. The method of claim 1

using second sensor data generated by an audio sensor to detect position of the object;

wherein automatically adjusting orientation of the imager includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function of the position of the recognized feature within the field of view and the determined position of the IR transmitter and the second sensor data.

11. The method of claim 1

using first sensor data generated by a motion sensor to detect position of the object;

wherein automatically adjusting orientation of the imager includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function of the position of the recognized feature within the field of view and the determined position of the IR transmitter and the first sensor data and the first sensor data and the second sensor data.

12. A system comprising:

a video imager configured to perform image recognition to recognize a feature of an object within an imager field of view and to determine a position of the feature within the field of view;

an IR transmitter disposed upon the object to transmit an infrared (IR) signal;

an IR sensor disposed to determine a position of the infrared (IR) transmitter; and

means for determining a position as a function of a recognized feature within the field of view and a determined position of the IR transmitter.

13. The system of claim 12 further including:

a servo system configured to receive the determined position information and to change orientation of the imager to follow the object in response to the received position information.

14. The system of claim 12,

wherein the means for determining includes a photocell.

15. The system of claim 12,

wherein the means for determining includes a processor configured to implement a sensor fusion process.

16. A method to track an object comprising:

directing a video imager to capture video images of an object within an imager field of view;

transmitting a first infrared (IR) signal by a first IR transmitter disposed upon the object to transmit the first IR signal in a first direction away from the object;

transmitting a second IR signal by a second IR transmitter disposed to transmit the second IR signal in a second direction toward the object so that the second IR signal reflects off the object in a third direction away from the object;

using an IR sensor to determine a position of the object based upon the first IR signal when the IR sensor is in a path of the first direction and to determine a position of the object based upon the second IR signal when the IR sensor is in a path of a path of the third direction; and

automatically adjusting orientation of the imager to follow the object in the field of view based upon the determined position of the object.

17. The method of claim 16,

wherein the second IR transmitter disposed adjacent to the imager.

18. The method of claim 16,

wherein the IR sensor is disposed adjacent to the imager;

and

wherein the second IR transmitter disposed adjacent to the imager.

19. The method of claim 16 further including:

wherein transmitting the first IR signal includes transmitting the first IR signal during first time slots; and

wherein transmitting the second IR signal includes transmitting the second IR signal during second time slots.

20. The method of claim 16 further including:

using the IR sensor to determine a position of the object based upon both the first IR signal and the second IR signal when the IR sensor is in both the path of the first direction and is in a path of a path of the third direction.

21. The method of claim 16,

wherein determining a position of the object includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function the determined position of the object based upon the first IR signal and the determined position of the object based upon the second IR signal.

22. The method of claim 16 further including:

using first sensor data generated by a motion sensor to detect position of the object;

wherein determining a position of the object includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function the determined position of the object based upon the first IR signal and the determined position of the object based upon the second IR signal and the first sensor data.

23. The method of claim 16

using second sensor data generated by an audio sensor to detect position of the object;

wherein determining a position of the object includes configuring a processor to implement a sensor fusion process to determine an updated final position of the object as a function the determined position of the object based upon the first IR signal and the determined position of the object based upon the second IR signal and the second sensor data.

24. The method of claim 16 further including:

automatically adjusting orientation of the imager based upon the determined position of the object.

25. A system comprising:

a video imager;

a first IR transmitter disposed upon the object to transmit a first IR signal in a first direction away from the object;

a second IR transmitter disposed to transmit a second IR signal in a second direction toward the object so that the second IR signal reflects off the object in a third direction away from the object;

an IR sensor disposed to determine a position of the object based upon the first IR signal when the IR sensor is in a path of the first direction and to determine a position of the object based upon the second IR signal when the IR sensor is in a path of a path of the third direction; and

means for automatically adjusting orientation of the imager to follow the object in the field of view based upon the determined position of the object.

26. The system of claim 25,

wherein the means for automatically adjusting includes a servo system configured to receive the determined position and to change orientation of the imager to follow the object in response to the received position information.

27. The system of claim 25,

wherein the means for automatically adjusting includes the imager configured to crop an image within the imager field of view.

28. A method to tag video data with information about content of the video data comprising:

directing a video imager to capture video images of an object;

using first sensor data generated by a sensor to detect position of the object;

automatically adjusting orientation of the imager as a function of the detected position of the object so as to follow movement of the object;

using second sensor data generated by a sensor to identify an event; and

storing the video data in a computer readable storage device in association with time stamps to indicate the relative time of occurrence of different portions of the video data and in association with a tag that identifies the detected event and that is associated with a time stamp.

29. The method of claim 28,

wherein the first sensor is disposed upon the object.

30. The method of claim 28,

wherein the second sensor is disposed on the object.

31. The method of claim 28,

wherein the first data sensor data and the second sensor data are generated by the same sensor.

32. The method of claim 28,

wherein the first data sensor data and the second sensor data are generated by the same motion sensor.

33. The method of claim 32,

wherein the motion sensor includes an accelerometer.

34. The method of claim 32,

wherein the motion sensor includes an gyroscope.

35. The method of claim 28,

wherein the first data sensor data and the second sensor data are generated by the same audio sensor.

36. The method of claim 28,

wherein the first data sensor data and the second sensor data are generated by different sensors.

37. The method of claim 36,

wherein the first sensor includes a first accelerometer;

and

wherein the second sensor includes a second accelerometer.

38. The method of claim 36,

wherein the first sensor includes an accelerometer;

and

wherein the second sensor includes an audio sensor.

39. A system comprising:

a video imager;

a first sensor;

a second sensor;

means for automatically adjusting orientation of the imager to follow an object within an imager field of view based upon object position information collected by the first sensor; and

a machine readable storage device encoded with storing video data captured by the video imager in association with time stamps to indicate the relative time of occurrence of different portions of the video data and in association with a tag that identifies an event detected by the second sensor wherein the tag is associated with a time stamp.

40. The system of claim 39,

wherein the first and second sensors comprise the same.

41. The system of claim 39,

wherein the first and second sensors comprise different sensor devices.

42. The system of claim 39,

wherein the means for automatically adjusting includes a servo system configured to receive the determined position and to change orientation of the imager to follow the object in response to the received position information.

43. The system of claim 39,

wherein the means for automatically adjusting includes the imager configured to crop an image within the imager field of view.