Modular camera and printer

• US 8,866,923 B2
• Filed: 08/05/2010
• Issued: 10/21/2014
• Est. Priority Date: 05/25/1999
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Silverbrook, Kia, Lapstun, Paul, Walmsley, Simon Robert
• Primary Examiner(s): HERNANDEZ, NELSON D
• Application Number:
  US12/850,627
• Publication Number:
  US 20100295951A1
• Time in Patent Office: 1,538 Days
• Field of Search: 348/222.1, 348/223.1, 348/207.1, 348/207.2, 348/207.11, 348/373, 348/376, 348/272, 382/254, 382/266, 382/312, 382/313, 382/303, 382/296, 382/166, 382/168, 382/169, 358/906
• US Class Current: 348/222.1
• CPC Class Codes: B41J 11/008 Controlling printhead for accurately positioning print image on printing material, e.g. with the intention to control the width of margins
• CPC Class Codes: B41J 13/02 Rollers roller platens B41J11/04
• CPC Class Codes: B41J 13/103 for the sheet feeding section
• CPC Class Codes: B41J 13/12 specially adapted for small cards, envelopes, or the like , e.g. credit cards, cut visiting cards
• CPC Class Codes: B41J 19/207 Encoding along a bar
• CPC Class Codes: B41J 2/01 Ink jet
• CPC Class Codes: B41J 2/155 for line printing
• CPC Class Codes: B41J 2/16508 connected with the printer frame
• CPC Class Codes: B41J 2/16579 Detection means therefor, e.g. for nozzle clogging
• CPC Class Codes: B41J 2/17503 Ink cartridges
• CPC Class Codes: B41J 2/17513 Inner structure
• CPC Class Codes: B41J 2/1752 Mounting within the printer
• CPC Class Codes: B41J 2/17523 Ink connection
• CPC Class Codes: B41J 2/17553 Outer structure
• CPC Class Codes: B41J 2/17566 Ink level or ink residue control
• CPC Class Codes: B41J 23/02 Mechanical power drives
• CPC Class Codes: B41J 29/02 Framework
• CPC Class Codes: B41J 29/023 with reduced dimensions
• CPC Class Codes: B41J 29/393 Devices for controlling or analysing the entire machine ; Controlling or analysing mechanical parameters involving printing of test patterns
• CPC Class Codes: B41J 3/36 for portability , i.e. hand-held printers or laptop printers B41J3/4075 takes precedence
• CPC Class Codes: B41J 3/44 : Typewriters or selective printing mechanisms having dual functions or combined with, or coupled to, apparatus performing other functions
• CPC Class Codes: B41J 3/445 : Printers integrated in other types of apparatus, e.g. printers integrated in cameras
• CPC Class Codes: B41J 3/46 : Printing mechanisms combined with apparatus providing a visual indication
• CPC Class Codes: G03B 15/05 : Combinations of cameras with electronic flash apparatus; Electronic flash units
• CPC Class Codes: G03B 17/02 : Bodies
• CPC Class Codes: G03B 17/50 : with both developing and finishing apparatus
• CPC Class Codes: G03B 2215/05 : Combinations of cameras with electronic flash units
• CPC Class Codes: G03B 29/00 : Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects combinations with flash apparatus G03B15/03
• CPC Class Codes: G07F 17/32 : for games, toys, sports, or amusements
• CPC Class Codes: G07F 17/3232 : wherein the operator is informed
• CPC Class Codes: G07F 17/3262 : Player actions which determine the course of the game, e.g. selecting a prize to be won, outcome to be achieved, game to be played
• CPC Class Codes: H04N 1/00249 : with a photographic apparatus, e.g. a photographic printer or a projector photographic apparatus per se G03B, G03D
• CPC Class Codes: H04N 1/00265 : with a photographic printing apparatus
• CPC Class Codes: H04N 1/00278 : with a printing apparatus, e.g. a laser beam printer
• CPC Class Codes: H04N 1/00347 : with another still picture apparatus, e.g. hybrid still picture apparatus circuits or arrangements for control or supervision between image input and image output device H04N1/32
• CPC Class Codes: H04N 1/00397 : Switches, knobs or the like
• CPC Class Codes: H04N 1/00538 : Modular devices, i.e. allowing combinations of separate components, removal or replacement of components
• CPC Class Codes: H04N 1/00541 : with detachable image reading apparatus
• CPC Class Codes: H04N 1/00557 : Connection or assembly of components or elements H04N1/00538 takes precedence
• CPC Class Codes: H04N 1/0083 : Arrangements for transferring signals between different components of the apparatus, e.g. arrangements of signal lines or cables for control or supervision between image input and output device H04N1/32
• CPC Class Codes: H04N 1/00962 : Input arrangements for operating instructions or parameters, e.g. updating internal software program loading in general G06F9/445; network-specific protocols involving the movement of software or configuration parameters H04L67/34
• CPC Class Codes: H04N 1/107 : with manual scanning
• CPC Class Codes: H04N 1/2112 : using still video cameras
• CPC Class Codes: H04N 1/2154 : the still video camera incorporating a hardcopy reproducing device, e.g. a printer
• CPC Class Codes: H04N 1/32358 : using picture signal storage, e.g. at transmitter H04N1/17 takes precedence
• CPC Class Codes: H04N 1/32598 : Bus based systems
• CPC Class Codes: H04N 1/387 : Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/405 : Halftoning, i.e. converting the picture signal of a continuous-tone original into a corresponding signal showing only two levels
• CPC Class Codes: H04N 1/52 : Circuits or arrangements for halftone screening
• CPC Class Codes: H04N 1/60 : Colour correction or control H04N1/54 takes precedence
• CPC Class Codes: H04N 1/6019 : using look-up tables H04N1/6025 takes precedence
• CPC Class Codes: H04N 1/62 : Retouching, i.e. modification of isolated colours only or in isolated picture areas only
• CPC Class Codes: H04N 2101/00 : Still video cameras
• CPC Class Codes: H04N 2201/001 : Sharing resources, e.g. processing power or memory, with a connected apparatus or enhancing the capability of the still picture apparatus
• CPC Class Codes: H04N 2201/0081 : Image reader H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0082 : Image hardcopy reproducer H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0084 : Digital still camera
• CPC Class Codes: H04N 2201/0096 : Portable devices
• CPC Class Codes: H04N 23/50 : Constructional details
• CPC Class Codes: H04N 23/51 : Housings

Abstract

A modular camera and printer is disclosed. A camera module is provided having an image sensor for capturing an image in a RGB format. The camera module also has a central processing unit with program memory for storing program steps for execution by the central processing unit to operate the camera module, and an image storage memory for storing the captured image in the RGB format. An image processing unit of the camera module is in communication with the image storage memory and transforms image data in the image storage memory into a L*a*b* format. The camera module also has a serial bus for outputting transformed image data in the L*a*b* format. A printer module is provided also having a serial bus in communication with the serial bus of the camera module. The printer module receives the image data from the camera module in the L*a*b* format, converts the image data to a color space of the printer module, and then prints the image data on a printhead.

Claims

1. A handheld device, comprising:

an image sensor for capturing an image;

one or more memories for storing image data that represents the captured image; and

one or more processors operatively coupled to the image sensor and the one or more memories, wherein the one or more processors are configured with computer executable instructions for;

reading the image data;

converting the image data into linearized RGB (red green blue) image data;

planarizing the linearized RGB image data; and

writing the planarized and linearized RGB image data to the one or more memories;

wherein planarizing the linearized RGB image data comprises storing data representing each of the red, green, and blue components of the image as an independent plane;

wherein each plane is a data structure that can be read or written independently of the other planes

wherein the one or more processors include an image capture processing unit, an image histogram processing unit, an image enhancement processing unit, and a central processing unit; and

wherein the image enhancement processing unit is configured with computer executable instructions for performing white-balancing, range expansion, image resampling, color conversion, and image sharpening in parallel.

2. The method of claim 1, wherein writing the planarized and linearized RGB image data to the one or more memories comprises:

writing each plane of linearized RGB image data to the one or more memories as an array of data distinct from the arrays of data corresponding to the other planes.

3. The handheld device of claim 1, wherein the image sensor is included in a camera component of the handheld device.

4. The handheld device of claim 1, wherein the one or more processors are included in an application specific integrated circuit (ASIC).

5. The handheld device according to claim 1, wherein the one or more processors are further configured with computer executable instructions for rotating the linearized RGB image data.

6. The handheld device according to claim 1, wherein the resampling comprises generating a full complement of red, green, and blue pixels for each coordinate present in the linearized RGB image data.

7. The handheld device according to claim 1, wherein the resampling includes calculating a medium resolution R, G, and B by pixels by running an image reconstruction filter on R, G, and B data, respectively.

8. The handheld device according to claim 1, wherein the computer executable instructions for performing color conversion comprise computer executable instructions for converting the linearized RGB image data to a color space that forms a superset of multiple traditional color spaces.

9. The handheld device according to claim 1, wherein the computer executable instructions for performing color conversion comprise computer executable instructions for converting the linearized RGB image data to L*a*b* format.

10. The handheld device according to claim 9, wherein the one or more processors are part of an integrated circuit and are further configured with computer executable instructions for transmitting the L*a*b* formatted image data out on a bus of the integrated circuit.

11. The handheld device according to claim 1, wherein the sharpening process involves a highpass filter of the luminance channel of the image.