Paper-based remote sketching system

• US 20020180726A1
• Filed: 11/06/2001
• Published: 12/05/2002
• Est. Priority Date: 11/06/2000
• Status: Abandoned Application

• Current Assignee: Jianbo Shi, Simon Baker
• Original Assignee: Jianbo Shi, Simon Baker
• Inventors: Baker, Simon, Shi, Jianbo
• Application Number:
  US09/682,999
• Publication Number:
  US 20020180726A1
• Time in Patent Office: Days
• US Class Current: 345/418
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 1/00702 Position
• CPC Class Codes: H04N 1/00737 using the scanning elements as detectors
• CPC Class Codes: H04N 1/00748 Detecting edges, e.g. of a stationary sheet
• CPC Class Codes: H04N 1/195 the array comprising a two-dimensional array or a combination of two-dimensional arrays
• CPC Class Codes: H04N 1/19594 using a television camera or a still video camera
• CPC Class Codes: H04N 1/42 Systems for two-way working , e.g. conference systems H04N1/32 takes precedence
• CPC Class Codes: H04N 2201/0081 Image reader H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0089 Image display device
• CPC Class Codes: H04N 2201/0436 Scanning a picture-bearing surface lying face up on a support H04N2201/0434 takes precedence; using cylindrical picture bearing surfaces H04N1/06; with manual scanning H04N1/107
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

A system allowing the real-time remote transmission of hand-drawn sketches drawn with conventional means (i.e., a pen or pencil and a piece of paper) is disclosed. The system tracks updates drawn on the paper and transmits them to remote sites. Updates may also be made at remote sites and viewed locally. Also provided are means for archiving and re-playing sequences of updates to a document. Significantly, the system has the ability to track any movements of the paper and to dynamically adjust the system to properly display the image correctly positioned on the paper at the remote sites.

Claims

1. A paper-based sketching system comprising:

a projector having a first field-of-view;

a video camera having a second field-of-view, said camera and said projector being arranged such that said first field-of-view and said second field of view substantially overlap, thereby forming a working area; and

a computer, coupled to said projector and said video camera, wherein images captured by said camera from a piece of paper located within said working area are transmitted to one or more remote paper-based sketching systems; and

further wherein images received from one or more remote paper-based sketching systems are projected onto said paper by said projector, regardless of the orientation of said paper within said working area.

2. The system of claim 1 wherein said computer can track the orientation of said paper within said working area and can dynamically adjust said projected image such that it is correctly oriented on said paper.

3. The system of claim 1 wherein said computer can detect when a hand is within said working area and further wherein said images are captured and stored after said hand has been removed from said working area.

4. The system of claim 1 further comprising:

a means for connecting said computer to a communications network, such that said captured images may be transmitted in real-time to remote paper-based sketching systems for remote display.

5. The system of claim 4 wherein said real-time transmission happens at a rate of at least approximately 30 frames per second.

6. The system of claim 3 wherein said transmitted images are also stored on said remote paper-based sketching system.

7. The system of claim 3 further comprising a means for tracking said images, such that said images can be replayed in the order in which they were captured.

8. The system of claim 1 further comprising one or more mirrors to assist in the alignment of said first and said second fields-of-view.

9. The system of claim 1 wherein said camera can capture said images regardless of background clutter or the level of ambient light available.

10. A paper-based sketching system comprising:

a video camera having a first field-of-view;

an adapter, for connecting said camera to a projector having a second field of view, such that said first field-of-view and said second field of view substantially overlap, thereby forming a working area; and

a computer, coupled to said projector and said video camera, wherein images captured by said camera from a piece of paper located within said working area are transmitted to one or more remote paper-based sketching systems; and

further wherein images received from one or more remote paper-based sketching systems are projected onto said paper by said projector, regardless of the orientation of said paper within said working area.

11. The system of claim 10 wherein said computer can track the orientation of said paper within said working area and can dynamically adjust said projected image such that it is correctly oriented on said paper.

12. The system of claim 10 wherein said computer can detect when a hand is within said working area and further wherein said images are captured and stored after said hand has been removed from said working area.

13. The system of claim 10 further comprising:

a means for connecting said computer to a communications network, such that said captured images may be transmitted to remote paper-based sketching systems for remote display.

14. The system of claim 13 wherein said real-time transmission happens at a rate of at least approximately 30 frames per second.

15. The system of claim 12 wherein said transmitted images are also stored on said remote paper-based sketching system.

16. The system of claim 12 further comprising a means for tracking said images, such that said images can be replayed in the order in which they were captured.

17. The system of claim 10 further comprising one or more mirrors to assist in the alignment of said first and said second fields-of-view.

18. The system of claim 10 wherein said camera can capture said images regardless of background clutter or the level of ambient light available.