Whiteboard imaging system

• US 6,904,182 B1
• Filed: 04/19/2000
• Issued: 06/07/2005
• Est. Priority Date: 04/19/2000
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Sinclair, Michael J., Simard, Patrice Y.
• Primary Examiner(s): Dastouri, Mehrdad
• Application Number:
  US09/552,370
• Time in Patent Office: 1,875 Days
• Field of Search: 382/274, 382/112, 382/113, 382/185, 382/186, 382/187, 382/189, 382/294, 382/284, 382/312, 358/412, 348/14.01, 348/14.04, 348/14.09
• US Class Current: 382/284
• CPC Class Codes: B43L 1/00 Repeatedly-usable boards or tablets for writing or drawing drawing-boards B43L5/00
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

An image capturing system is installable in a room opposite a writing surface. The image capturing system is adapted to take visual images of the writing surface and identify information written thereon.

Claims

1. An image capturing system comprising:

a visual sensor adapted to provide image data corresponding to sensed visual images of a writing surface and a second area spaced apart from the writing surface, wherein the sensed visual images each comprise successive linear array portions;

an image processor coupled to the visual sensor to receive the image data from the visual sensor, the image processor adapted to identify information provided on the writing surface apart from the writing surface and further adapted to identify information provided on the second area apart from the second area;

a storage device for storing reference visual images, wherein the image processor is coupled to the storage device to access the reference visual images corresponding to each of the writing surface and the second area to identify information provided on the writing surface and the second area, wherein the image processor is adapted to identify an area requiring reimaging, and wherein the image processor controls the visual sensor to obtain at least one second visual image corresponding to the at least one portion of the writing surface or the second area, if reimaging is required, and wherein the processor is adapted to combine the first-mentioned visual images with the at least one second visual image.

2. The image capturing system of claim 1, wherein the storage device stores processing values comprising a first processing value and a second processing value, and wherein the image processor processes the image data of the first writing surface using the first processing value, and wherein the image processor processes the image data of the second area using the second processing value.

3. The image capturing system of claim 2 wherein the visual sensor includes a zoom lens, and wherein the first processing value relates to a first setting of the zoom lens and the second processing value relates to a second setting of the zoom lens.

4. The image capturing system of claim 1, wherein the visual sensor comprises a sensing device having a plurality of sensing elements.

5. The image capturing system of claim 4 wherein the sensing device comprises a linear array of sensing elements.

6. The image capturing system of claim 4 wherein a sensing element control value is provided for each sensing element for each successive linear array portion of the images.

7. The image capturing system of claim 1, wherein the visual sensor comprises a sensing device adapted to scan the writing surface and the second area.

8. The image capturing system of claim 1 and further comprising a storage device for storing processing values related to correction of the visual images from the writing surface and the second area for optical distortion, wherein the image processor is coupled to the storage device to access and use the processing values during image processing.

9. The image capturing system of claim 1, wherein the visual sensor is disposed above the writing surface.

10. The combination of claim 9 wherein the visual sensor is mounted to a ceiling of the room.

11. The image capturing system of claim 1 wherein the visual sensor is disposed within the room to sense images of the writing surface and the second area spaced apart from the writing surface.

12. The combination of claim 11 wherein the visual sensor is mounted to a wall of the room.

13. The combination of claim 12 wherein the visual sensor is disposed above the writing surface.

14. The combination of claim 13 wherein the visual sensor is mounted to a ceiling of the room.

15. A method of obtaining information provided on a writing surface and a second area spaced apart from the writing surface in a room, the method including:

locating an image capturing system at a second location in the room remote from the writing surface and the second area;

sensing visual images from each of the writing surface and the second area with the image capturing system, wherein sensing comprises sensing successive linear array portions of the visual images;

identifying information provided on the writing surface and the second area with the image capturing system, wherein identifying information includes identifying information as a function of reference visual images of the writing surface and the second area;

reimaging at least the at least one area of the writing surface and the second area to obtain at least one second visual image; and

combining first-mentioned at lease one visual image with the second at least one visual image, wherein sensing includes sensing a plurality of visual images of each of the writing surface and the second area, wherein identifying includes identifying information as a function of the plurality of visual images from each of the writing surface and the second area, wherein identifying information includes detecting at lease one area of the writing surface and the second area requiring reimaging.

16. The method of claim 15, wherein sensing visual images includes compensating for distortion of the visual images.

17. The method of claim 15 wherein identifying includes comparing a first visual image to a second visual image.

18. The method of claim 15 wherein sensing visual images includes initiating sensing of a visual image with a switch movable relative to the second location.

19. The method of claim 15, wherein the image capturing system is selectively directable to obtain the visual images of each of the writing surface and the second area, the method further comprising directing the image capture system toward the writing surface and the second area.

20. The method of claim 19 wherein a switch is operated to direct the image capture system toward the writing surface and the second area.

21. The method of claim 19 wherein sensing comprises providing image data corresponding to the visual images of each of the writing surface and the second area, and wherein the method further comprises storing a first processing value and a second processing value, and processing the image data using the first processing value and the second processing value as a function of direction of the image capture system toward the writing surface and the second area, respectively.

22. The method of claim 15 wherein sensing comprises scanning each of the writing surface and the second area.