Whiteboard imaging system

• US 7,450,786 B2
• Filed: 11/19/2004
• Issued: 11/11/2008
• Est. Priority Date: 04/19/2000
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Sinclair, Michael J., Simard, Patrice Y.
• Primary Examiner(s): PATEL, KANJIBHAI B
• Application Number:
  US10/993,965
• Publication Number:
  US 20050068308A1
• Time in Patent Office: 1,453 Days
• Field of Search: 382112-113, 382/185, 382/187, 382/189, 382/274, 382/284, 382/312, 382/294, 358/412, 348/14.01, 348/14.04, 348/14.09
• US Class Current: 382/312
• CPC Class Codes: B43L 1/00 Repeatedly-usable boards or tablets for writing or drawing drawing-boards B43L5/00
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

An image capturing system is installable in a room opposite a writing surface. The image capturing system is adapted to take visual images of the writing surface and identify information written thereon.

Claims

1. An image capturing system comprising:

a visual sensor providing image data corresponding to sensed images, the visual sensor selectively directed toward a first writing surface to sense successive linear array portions of a first image and toward a second area spaced apart from the first writing surface to sense successive linear array portions of a second image, wherein the first and second images are not portions of a single image; and

an image processor coupled to the visual sensor to receive the image data from the visual sensor, the image processor adapted to process the image data as a function of processing values, wherein the processing values are a function of direction of the visual sensor toward the first writing surface and the second area.

2. The image capturing system of claim 1, and further comprising:

a storage device for storing the processing values comprising a first processing value and a second processing value, wherein the image processor processes the image data of the first writing surface using the first processing value, and wherein the image processor processes the image data of the second area using the second processing value.

3. The image capturing system of claim 2, wherein the visual sensor includes a zoom lens, and wherein the first processing value relates to a first setting of the zoom lens and the second processing value relates to a second setting of the zoom lens.

4. The image capturing system of claim 2, wherein the first processing value relates to an optical correction for distortion of the first image and the second processing value relates to an optical correction for distortion of the second image.

5. The image capturing system of claim 1, wherein the visual sensor comprises a sensing device having a plurality of sensing elements.

6. The image capturing system of claim 5, wherein the sensing device comprises a linear array of sensing elements.

7. An image capturing system comprising:

a visual sensor adapted to provide image data corresponding to sensed visual images of a writing surface and a second area spaced apart from the writing surface, wherein the sensed visual images each comprise successive linear array portions, and wherein the sensed visual images are not portions of a single image;

an image processor coupled to the visual sensor to receive the image data from the visual sensor, the image processor adapted to identify information provided on the writing surface apart from the writing surface and further adapted to identify information provided on the second area apart from the second area; and

a storage device for storing reference visual images, wherein the image processor is coupled to the storage device to access the reference visual images corresponding to each of the writing surface and the second area to identify information provided on the writing surface and the second area.

8. The image capturing system of claim 7, wherein the visual sensor comprises a sensing device adapted to scan the writing surface and the second area.

9. The image capturing system of claim 7, and further comprising a storage device for storing processing values related to correction of the visual images from the writing surface and the second area for optical distortion, wherein the image processor is coupled to the storage device to access and use the processing values during image processing.

10. The image capturing system of claim 7, wherein the image processor is adapted to identify an area requiring reimaging.

11. An image capturing system comprising:

a visual sensor providing image data corresponding to sensed images from each of a writing surface and a second area spaced apart from the writing surface, the visual sensor comprising a set of adjacent sensing elements being exposed collectively to successive linear array portions of the images, wherein images on the writing surface and second area are not portions of a single image;

a storage device for storing sensing element control values; and

a controller coupled to the storage device and the visual sensor, the controller controlling a time duration of exposure of the sensing elements to each linear array portion of images as a function of exposure to successive linear array portions.

12. The image capturing system of claim 11, wherein a sensing element control value is provided for each sensing element for each successive linear array portion of the images.

13. The image capturing system of claim 11, and further comprising:

an image processor coupled to the visual sensor to receive the image data from the visual sensor, the image processor adapted to identify information provided on the writing surface and the second area apart from the writing surface or the second area, respectively.

14. The image capturing system of claim 13, and further comprising a storage device for storing reference visual images from each of a writing surface and a second area, and wherein the image processor is coupled to the storage device to access the reference visual images to identify information provided on the writing surface and the second area.

15. The image capturing system of claim 13, and further comprising a storage device for storing processing values related to correction of each visual image for optical distortion, wherein the image processor is coupled to the storage device to access and use the processing values during image processing.

16. In combination with a defined writing surface provided in a fixed location in a room and a second area spaced apart from the writing surface, an image capturing system disposed in the room at a second location remote from the writing surface and the second area adapted to sense successive visual images from each of the writing surface and the second area and adapted to identify information provided on the writing surface and the second area, wherein sensing comprises sensing successive linear array portions of each visual image, wherein the images on the writing surface and the second area are not portions of a single image, and wherein the image capturing system includes an image processor adapted to identify information on the writing surface and a second area as a function of reference visual images of each of the writing surface and the second area.

17. The combination of claim 16, wherein the image capturing system includes a visual sensor disposed above the writing surface.

18. The combination of claim 17, wherein the visual sensor is mounted to a ceiling of the room.

19. The combination of claim 16, wherein the image capturing system includes a visual sensor disposed within the room to sense images of the writing surface and the second area spaced apart from the writing surface.

20. The combination of claim 19, wherein the visual sensor is mounted to a wall of the room.

21. The combination of claim 19, wherein the visual sensor is disposed above the writing surface.

22. The combination of claim 21, wherein the visual sensor is mounted to a ceiling of the room.

23. The combination of claim 16, wherein the image capturing system includes a visual sensor adapted to scan the writing surface and the second area.

24. A method of obtaining information provided on a writing surface and a second area spaced apart from the writing surface in a room, the method including:

locating an image capturing system at a location in the room remote from the writing surface and the second area;

sensing visual images from each of the writing surface and the second area with the image capturing system, wherein sensing comprises sensing successive linear array portions of the visual images, and wherein the visual images from the writing surface and second area are not portions of a single image; and

identifying information provided on the writing surface and the second area with the image capturing system, wherein identifying information includes identifying information as a function of reference visual images of the writing surface and the second area.

25. The method of claim 24, wherein sensing visual images includes compensating for distortion of the visual images.

26. The method of claim 24 wherein sensing includes sensing a plurality of visual images of each of the writing surface and the second area.

27. The method of claim 26, wherein identifying includes identifying information as a function of a plurality of visual images from each of the writing surface and the second area.

28. The method of claim 27, wherein identifying includes comparing a first visual image to a second visual image.

29. The method of claim 28, wherein sensing a visual image includes initiating sensing of a visual image with a switch movable relative to the second location.

30. The method of claim 27, wherein the image capturing system is selectively directable to obtain the visual image of each of the writing surface and the second area, the method further comprising directing the image capture system toward the writing surface and the second area, and wherein sensing includes sensing a visual image of each of the writing surface and the second area.

31. The method of claim 30, wherein a switch is operated to direct the image capture system toward the writing surface and the second area.

32. The method of claim 30, wherein sensing comprises providing image data corresponding to the visual images of each of the writing surface and the second area, and wherein the method further comprises storing a first processing value and a second processing value, and processing the image data using the first processing value and the second processing value as a function of direction of the image capture system toward the writing surface and the second area, respectively.

33. The method of claim 27, wherein sensing comprises scanning each of the writing surface and the second area.

34. The method of claim 27, wherein identifying information includes detecting at least one area of the writing surface and the second area requiring reimaging.