System and method for tracking an object during video communication

• US 20030169339A1
• Filed: 10/01/2001
• Published: 09/11/2003
• Est. Priority Date: 10/01/2001
• Status: Abandoned Application

• Current Assignee: Digeo Incorporated (CommScope Holding Company, Inc.)
• Original Assignee: Digeo Incorporated (CommScope Holding Company, Inc.)
• Inventors: Allen, Paul G., Billmaier, James A., Novak, Robert E.
• Application Number:
  US09/968,691
• Publication Number:
  US 20030169339A1
• Time in Patent Office: Days
• US Class Current: 348/169
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact

Abstract

An object is tracked with a camera that is sensitive to both visible and invisible light. An invisible light reflector attached to the object may reflect a target of invisible light, which is provided by an invisible light emitter. The camera processes the invisible light and moves the field of view of the camera so that the object is centered within the field of view. The camera may also zoom the field of view to a desired magnification level.

Claims

1. A system for automatically tracking an object with a camera, the system comprising:

a reflector, disposed on an object to be tracked, that reflects a target of invisible light;

a camera, sensitive to invisible light, that captures a first video signal depicting the object, the first video signal having visible and invisible components; and

a tracking subsystem that utilizes the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

2. The system of claim 1, wherein the invisible light comprises infrared light.

3. The system of claim 1, wherein the invisible light comprises ultraviolet light.

4. The system of claim 1, wherein the tracking subsystem comprises a vector calculator that calculates a vector from the camera to the reflector based on a location of the target within the invisible component of the first video signal.

5. The system of claim 4, wherein the tracking subsystem comprises a camera alignment subsystem that physically aligns the camera along the calculated vector.

6. The system of claim 1, wherein the tracking subsystem determines whether the target is centered within the first field-of-view and, if the target is not centered, moves the first field-of-view of the camera in a direction calculated to center the target within the first field-of-view until the target is centered.

7. The system of claim 1, wherein the tracking subsystem comprises an objectivication algorithm that analyzes motion of the object to determine a shape of the object.

8. The system of claim 1, wherein the first field-of-view is a cropped subset of a second field-of-view of the camera, and wherein the tracking subsystem moves the first field-of-view to a location of the second field-of-view in which the target is centered.

9. The system of claim 1, wherein the reflector comprises a reflective side and a non-reflective side, the non-reflective side comprising an adhesive for affixing the reflector to the object to be tracked.

10. The system of claim 1, wherein the object to be tracked comprises a person engaged in video communication using the camera.

11. The system of claim 10, wherein the reflector is attached to an article worn by the person.

12. The system of claim 11, wherein the article is selected from the group consisting of a pair of glasses, a tie clip, and a piece of jewelry.

13. The system of claim 10, wherein the reflector comprises a coating applied directly to skin of the person, wherein the coating reflects invisible light.

14. The system of claim 1, wherein the object to be tracked is selected from the group consisting of a remote control device and a set of keys.

15. The system of claim 1, further comprising:

a local display device viewable from within the first field-of-view that displays at least a subset of the visible component of the first video signal.

16. The system of claim 1, further comprising:

a communication subsystem that transmits at least a subset of the visible component of the first video signal to a remote terminal for display.

17. The system of claim 16, wherein the communication subsystem is configured to use a network selected from the group consisting of a cable television network and a direct broadcast satellite network.

18. The system of claim 17, further comprising:

a codec that receives television programming from the communication subsystem for display on a local display device viewable from within the first field-of-view, wherein the codec and the tracking subsystem are disposed within a common housing to form a set top box, and wherein the set top box transmits the first signal from the camera to the communication subsystem.

19. The system of claim 16, wherein the communication subsystem receives a second video signal from the remote terminal, the system further comprising:

a local display device that displays the second video signal.

20. The system of claim 19, wherein the second video signal at least a subset of the visible component of the first video signal are displayed simultaneously.

21. The system of claim 1, further comprising:

a range finder that calculates a distance between the object and the camera.

22. The system of claim 21, wherein the first field-of-view has a magnification level, the system further comprising:

a zoom subsystem that adjusts the magnification level of the first field-of-view based on the calculated distance between the object and the camera.

23. The system of claim 1, wherein the first field-of-view has a magnification level, the system further comprising:

a zoom subsystem that maintains a ratio of object size to first field-of-view size substantially constant during motion of the object.

24. The system of claim 23, wherein the ratio of object size to first field-of-view size is user selectable.

25. The system of claim 1, wherein the camera comprises:

a wide frequency charge-coupled device (CCD) that generates the visible-light component and the invisible-light component of the first video signal.

26. The system of claim 1, wherein the camera comprises:

a first charge-coupled device (CCD) that generates the visible-light component of the first video signal; and

a second CCD that generates the invisible-light component of the first video signal.

27. A system for automatically tracking an object with a camera, the system comprising:

an camera, sensitive to invisible light, that captures a first video signal of an object having a reflector disposed thereon to reflect a target of invisible light, the first video signal having visible and invisible components; and

a tracking subsystem that utilizes the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

28. A system for automatically tracking an object with a camera, the system comprising:

a camera, sensitive to invisible light, that captures a first video signal of an object having a reflector disposed thereon to reflect a target of invisible light, the invisible light generated by an invisible light emitter, the first video signal having visible and invisible components; and

a tracking subsystem that utilizes the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

29. A system for automatically tracking an object with a camera, the system comprising:

an invisible-light emitter, disposed on an object to be tracked, for emitting a target of invisible light;

a camera, sensitive to invisible light, that captures a first video signal depicting the object, the first video signal having visible and invisible components; and

a tracking subsystem that utilizes the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

30. The system of claim 29, wherein the invisible light comprises infrared light.

31. The system of claim 29, wherein the invisible light comprises ultraviolet light.

32. The system of claim 29, wherein the invisible-light emitter comprises an emissive side and a non-emissive side, the non-emissive side comprising an adhesive for affixing the emitter to the object to be tracked.

33. The system of claim 29, wherein the emitter comprises:

a power source that provides electrical potential; and

an invisible light generator electrically-coupled to the power source to convert electrical potential into invisible light.

34. The system of claim 29, wherein the object to be tracked comprises a person engaged in video communication using the camera.

35. The system of claim 34, wherein the emitter is attached to an article worn by the person.

36. The system of claim 35, wherein the article is selected from the group consisting of a pair of glasses, a tie clip, and a piece of jewelry.

37. The system of claim 29, wherein the object to be tracked is selected from the group consisting of a remote control device and a set of keys.

38. A system for tracking an individual during video communication, the system comprising:

an infrared-sensitive camera that captures a first video signal depicting the individual, the first video signal having infrared and visible-light components;

a targeting subsystem that identifies a target comprising an area of infrared intensity within the infrared component of the first video signal; and

a tracking subsystem that utilizes the infrared component to orient a first field-of-view of the camera to center the target within the first field-of-view.

39. The system of claim 38, wherein the area of infrared intensity corresponds to at least a portion of a head of the individual.

40. The system of claim 38, wherein the targeting subsystem determines a magnitude of infrared intensity of the target to identify the target.

41. The system of claim 38, wherein the targeting subsystem determines a size of the target to identify the target.

42. The system of claim 38, wherein the targeting subsystem determines a wavelength of infrared radiation from the target to identify the target.

43. The system of claim 38, wherein the first field-of-view has a magnification level, the system further comprising:

a zoom subsystem that maintains a ratio of object size to first field-of-view size substantially constant during motion of the object.

44. The system of claim 43, wherein the zoom subsystem determines a size of the area of infrared intensity to obtain the ratio of object size to first field-of-view size.

45. The system of claim 38, further comprising:

a local display device viewable from within the first field-of-view that displays at least a subset of the visible component of the first video signal.

46. The system of claim 38, further comprising:

a communication subsystem that transmits at least a subset of the visible component of the first video signal to a remote terminal for display.

47. The system of claim 46, wherein the communication subsystem is configured to use a network selected from the group consisting of a cable television network and a direct broadcast satellite network.

48. The system of claim 47, further comprising:

a codec that receives television programming from the communication subsystem for display on a local display device viewable from within the first field-of-view, wherein the codes and the tracking subsystem are disposed within a common housing to form a set top box, and wherein the set top box transmits the first signal from the camera to the communication subsystem.

49. The system of claim 46, wherein the communication subsystem receives a second video signal from the remote terminal, the system further comprising:

a local display device that displays the second video signal.

50. The system of claim 49, wherein the second video signal and at least a subset of the visible component of the first video signal are displayed simultaneously.

51. A method for automatically tracking an object with a camera, the method comprising:

reflecting a target of invisible light with a reflector disposed on an object to be tracked;

capturing a first video signal depicting the object with a camera sensitive to invisible light, the first video signal having visible and invisible components; and

utilizing the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

52. The method of claim 51, wherein the invisible light comprises infrared light.

53. The method of claim 51, wherein the invisible light comprises ultraviolet light.

54. The method of claim 51, further comprising:

calculating a vector from the camera to the reflector based on a location of the target within the first field-of-view.

55. The method of claim 54, wherein orienting the first field-of-view comprises physically aligning the camera along the calculated vector.

56. The method of claim 51, further comprising:

determining whether the target is centered within the first field-of-view and, if the target is not centered, moving the first field-of-view of the camera in a direction calculated to center the target within the first field-of-view until the target is centered.

57. The method of claim 51, further comprising analyzing motion of the object to determine a shape of the object.

58. The method of claim 51, wherein the first field-of-view is a cropped subset of a second field-of-view of the camera, and wherein orienting the first field-of-view comprises moving the first field-of-view to a location of the second field-of-view in which the target is centered.

59. The method of claim 51, further comprising affixing the reflector to the object to be tracked with an adhesive disposed on a non-reflective side of the reflector, the reflector further having a reflective side.

60. The method of claim 51, wherein the object to be tracked comprises a person engaged in video communication using the camera.

61. The method of claim 60, further comprising attaching the reflector to an article worn by the person.

62. The method of claim 61, wherein the article is selected from the group consisting of a pair of glasses, a tie clip, and a piece of jewelry.

63. The method of claim 60, further comprising applying a coating directly to skin of the person, wherein the coating reflects invisible light.

64. The method of claim 51, wherein the object to be tracked is selected from the group consisting of a remote control device and a set of keys.

65. The method of claim 51, further comprising:

displaying at least a subset of the visible component of the first video signal at a location viewable from within the first field-of-view.

66. The method of claim 51, further comprising:

transmitting at least a subset of the visible component of the first video signal to a remote terminal for display.

67. The method of claim 66, wherein at least a subset of the visible component of the first video signal is transmitted through a network selected from the group consisting of a cable television network and a direct broadcast satellite network.

68. The method of claim 67, further comprising:

receiving television programming from the network for display at a location viewable from within the first field-of-view, wherein orienting the first field-of-view and receiving the television programming are performed within a set top box, and wherein the set top box transmits the first signal from the camera to the network.

69. The method of claim 66, further comprising:

receiving a second video signal from the remote terminal; and

displaying the second video signal on a local display device.

70. The method of claim 69, wherein the second video signal and at least a subset of the visible component of the first video signal are displayed simultaneously.

71. The method of claim 51, further comprising:

calculating a distance between the object and the camera.

72. The method of claim 71, wherein the first field-of-view has a magnification level, the method further comprising:

adjusting the magnification level of the first field-of-view based on the calculated distance between the object and the camera.

73. The method of claim 51, wherein the first field-of-view has a magnification level, the method further comprising:

maintaining a ratio of object size to first field-of-view size substantially constant during motion of the object.

74. The method of claim 73, wherein the ratio of object size to first field-of-view size is user selectable.

75. The method of claim 51, wherein capturing the first video signal comprises:

exposing a wide frequency charge-coupled device (CCD) to visible light and to the invisible light to generate the visible and invisible components of the first video signal.

76. The method of claim 51, wherein capturing the first video signal comprises:

exposing a first charge-coupled device (CCD) to visible light to generate the visible-light component of the first video signal; and

exposing a second charge-coupled device to the invisible light to generate the invisible-light component of the first video signal.

77. A method for automatically tracking an object with a camera, the method comprising:

emitting invisible light;

capturing a first video signal depicting the object with a camera sensitive to invisible light, the object having a reflector disposed thereon to reflect a target of invisible light, the first video signal having visible and invisible components; and

utilizing the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

78. A method for automatically tracking an object with a camera, the method comprising:

capturing a first video signal depicting the object with a camera sensitive to invisible light, the object having a reflector disposed thereon to reflect a target of invisible light, the invisible light generated by an invisible light emitter, the first video signal having visible and invisible components; and

utilizing the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

79. A method for automatically tracking an object with a camera, the method comprising:

emitting a target of invisible light with an invisible-light emitter disposed on an object to be tracked;

capturing a first video signal depicting the object with a camera sensitive to invisible light, the first video signal having visible and invisible components; and

utilizing the invisible component to orient a first field-of-view of the camera to center the target within the first field-of-view.

80. The method of claim 79, wherein the invisible light comprises infrared light.

81. The method of claim 79, wherein the invisible light comprises ultraviolet light.

82. The method of claim 79, further comprising affixing the emitter to the object to be tracked with an adhesive disposed on a non-emissive side of the reflector, the reflector further having an emissive side.

83. The method of claim 79, wherein the emitter comprises:

a power source that provides electrical potential; and

an invisible light generator electrically coupled to the power source to convert electrical potential into invisible light.

84. The method of claim 79, wherein the object to be tracked comprises a person engaged in video communication using the camera.

85. The method of claim 84, further comprising attaching the emitter to an article worn by the person.

86. The method of claim 85, wherein the article is selected from the group consisting of a pair of glasses, a tie clip, and a piece of jewelry.

87. The method of claim 79, wherein the object to be tracked is selected from the group consisting of a remote control device and a set of keys.

88. A method for tracking an individual during video communication, the method comprising:

capturing a first video signal of an individual with an infrared-sensitive camera, the first video signal having infrared and visible-light components;

identifying a target comprising an area of infrared intensity within the infrared component of the first video signal; and

utilizing the infrared component to orient a first field-of-view of the camera to center the target within the first field-of-view.

89. The method of claim 88, wherein the area of infrared intensity corresponds to at least a portion of a head of the individual.

90. The method of claim 88, further comprising determining a magnitude of infrared intensity of the target.

91. The method of claim 88, further comprising determining a size of the target.

92. The method of claim 88, further comprising determining a wavelength of infrared radiation from the target.

93. The method of claim 88, wherein the first field-6f-view has a magnification level, the method further comprising:

maintaining a ratio of object size to first field-of-view size substantially constant during motion of the object.

94. The method of claim 93, further comprising determining a size of the area of infrared intensity to obtain the ratio of object size to first field-of-view size.

95. The method of claim 88, further comprising:

displaying at least a subset of the visible component of the first video signal at a location viewable from within the first field-of-view.

96. The method of claim 88, further comprising:

transmitting at least a subset of the visible component of the first video signal to a remote terminal for display.

97. The method of claim 96, wherein at least a subset of the visible component of the first video signal is transmitted through a network selected from the group consisting of a cable television network and a direct broadcast satellite networks.

98. The method of claim 97, further comprising:

receiving television programs from the network for display at a location viewable from within the first field-of-view, wherein orienting the first field-of-view and receiving the television programming are performed within a set top box, and wherein the set top box transmits the first signal from the camera to the network.

99. The method of claim 96, further comprising:

receiving a second video signal from the remote terminal; and

displaying the second video signal on a local display device.

100. The method of claim 99, wherein the second video signal and at least a subset of the visible component of the first video signal are displayed simultaneously.

101. A system for automatically tracking an object with a camera, the system comprising:

means for emitting invisible-light;

means, disposed on an object to be tracked, for reflecting a target of invisible light;

a camera, sensitive to invisible light, that captures a first video signal depicting the object, the first video signal having visible and invisible components; and

means, utilizing the invisible component, for orienting a first field-of-view of the camera to center the target within the first field-of-view.