Computer system with handwriting annotation

• US 6,054,990 A
• Filed: 07/05/1996
• Issued: 04/25/2000
• Est. Priority Date: 07/05/1996
• Status: Expired due to Term

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Bao Q. Tran
• Inventors: Tran, Bao Q.
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): BAUTISTA, XIOMARA L
• Application Number:
  US08/684,842
• Time in Patent Office: 1,390 Days
• Field of Search: 345/173-183, 345/326, 345/329-332, 345/345, 345/358, 345/978, 348/64, 348/96, 348/231, 348/232, 348/552, 382/309, 382/311, 396/211, 396/310, 396/313, 396/321, 396/429
• US Class Current: 715/863
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The present invention provides a graphical data entry system for accepting and processing hand sketches and writings such that the user can quickly specify graphical objects in a drawing on a hand-held, mobile computer with a relatively compact screen. A viewing glass is provided by the graphical data entry system which enables the user to pan and zoom into a specific display region of the drawing. An object classification and recognition capability is provided to allow the present invention to recognize objects being sketched by the user and to convert the hand sketches into computer aided design (CAD)-like drawings. Further, the present invention integrates speech recognition and keyboard data entry to provide a user friendly computer system. Additionally, the graphical data entry system of the present invention can be used in conjunction with a camera to annotate pictures taken with the camera. The present invention can operate with digital cameras, APS-compatible cameras and conventional cameras which work with silver halide type films. Further, the drawing system of the present invention can be used in two-way messaging systems to support graphical paging requests and replies. The present invention also supports an intelligent agent operating with remote computers to locate and respond with responsive information, as specified using the graphical data entry system of the present invention.

Claims

1. A computer system for sketching an illustration and for writing annotations by a user, said computer system comprising:

a processor;

a memory device coupled to said processor;

a display device coupled to said processor;

an input device adapted to receive a user annotation or a sketch;

a keypad coupled to said processor;

a lens coupled to said processor, said lens adapted to capture an image;

a shutter coupled to said processor;

an image sensor coupled to said processor for detecting photographic conditions;

a photographic media adapted to receive said image and said user annotation;

a non-cursive handwriting recognizer adapted to receive a predetermined set of non-cursive characters from the input device; and

an encoder adapted to be coupled to said processor and to said photographic media, said encoder adapted to archive said annotation and sketch and said image onto the photographic media.

2. The computer system of claim 1, further comprising:

a library of predetermined objects including drawing elements and characters, said library storing strokes corresponding to each of said predetermined objects;

an object recognizer coupled to said input device and said library, said object recognizer identifying a best-fitting object from said library based on said strokes, said object recognizer generating a fit-value for said best-fitting object; and

a handwriting recognizer coupled to said input device and said library, said handwriting recognizer identifying a best-fitting character from said library based on said strokes if said fit-value is below a predetermined threshold.

3. The computer system of claim 1, wherein said photographic media has a light-sensitive front portion adapted to face said lens and a back portion having a data storage media adapted to encode said annotation and sketch by said encoder.

4. The computer system of claim 3, wherein said photographic media is compatible with an Advanced Photographic System (APS).

5. The computer system of claim 1, wherein said photographic media is a silver halide film and wherein said encoder is an optical encoder adapted to generate a light beam directed at said photographic media.

6. The computer system of claim 1, wherein said photographic media is a magnetic disk, further comprising a light receptor device coupled to said processor for capturing and digitizing said image.

7. The computer system of claim 1, further comprising a compression engine coupled to said processor and said encoder for compressing said image before archiving said image and text onto said media.

8. The computer system of claim 1, further comprising a code adapted to receive inputs from a user, said code adapted to receiving keypad commands for adjusting said lens position for focus and said shutter to optimize the exposure of said photographic media, said code further saving said user annotation or said sketch on said photographic media.

9. The computer system of claim 1, further comprising a remote computer and a transceiver coupled to said processor, said transceiver adapted to transmit said image, said annotation and said sketch to said remote computer.

10. The computer system of claim 1, wherein said user dictates a verbal annotation to said input recognizer, said input recognizer further comprises:

a microphone coupled to said processor for capturing a verbal annotation from the user; and

a speech recognizer coupled to said processor and said microphone, said speech recognizer converting said verbal annotation into text annotation.