Graphical application system

• US 8,875,655 B2
• Filed: 03/20/2012
• Issued: 11/04/2014
• Est. Priority Date: 09/22/2010
• Status: Active Grant

• Current Assignee: Hexagon Technology Center GmbH (Hexagon AB)
• Original Assignee: Hexagon Technology Center GmbH (Hexagon AB)
• Inventors: Pettersson, Bo, Schneider, Klaus, Zebhauser, Benedikt, Siercks, Knut
• Primary Examiner(s): TADESSE, YEWEBDAR T
• Application Number:
  US13/425,118
• Publication Number:
  US 20120219699A1
• Time in Patent Office: 959 Days
• Field of Search: 118/300, 118313-315, 118/712, 118/713, 118/321, 118/323, 118/679, 427/427.1, 427/8, 427/9, 239/71, 239/73, 239/67, 382/154
• US Class Current: 118/713
• CPC Class Codes: B05B 12/00 Arrangements for controlling delivery; Arrangements for controlling the spray area
• CPC Class Codes: B05B 12/084 responsive to condition of liquid or other fluent material already sprayed on the target, e.g. coating thickness, weight or pattern
• CPC Class Codes: B05B 12/12 responsive to conditions of ambient medium or target, e.g. humidity, temperature position or movement of the target relative to the spray apparatus B05B12/082, B05B12/084 take precedence
• CPC Class Codes: B05B 12/122 responsive to presence or shape of target B05B12/124 takes precedence
• CPC Class Codes: B05B 12/124 responsive to distance between spray apparatus and target
• CPC Class Codes: B05B 12/1472 separate supply lines supplying different materials to separate outlets of the spraying apparatus B05B12/1454 takes precedence
• CPC Class Codes: B05B 13/04 the spray heads being moved during spraying operation
• CPC Class Codes: B05B 7/0846 with jets being only jets constituted by a liquid or a mixture containing a liquid
• CPC Class Codes: B41J 3/4073 Printing on three-dimensional objects not being in sheet or web form, e.g. spherical or cubic objects B41J3/283, B41J3/286 take precedence; building up a 3D object using individual droplets from jetting heads B29C64/112
• CPC Class Codes: G01B 11/002 for measuring two or more coordinates
• CPC Class Codes: G01S 19/38 Determining a navigation solution using signals transmitted by a satellite radio beacon positioning system
• CPC Class Codes: H04N 13/246 Calibration of cameras

Abstract

A graphical application system, with a surface spattering device, with at least one nozzle for expelling a spattering material onto a target surface, a nozzle control mechanism controls expelling of the nozzle. A spatial referencing unit references the spattering device in space and a computation means automatically controls the nozzle according to information from the spatial referencing unit and according to predefined desired spattering data as a digital image or a CAD-model of a desired pattern to be spattered onto the target surface. A communication means for establishing a communication link from the spatial referencing unit to the computation means to supply the position and orientation to the computation means. The spatial referencing unit is located remote from the spattering device and comprises at least two optical 2D cameras arranged with a stereobasis, for determining the position and orientation of images taken by the cameras.

Claims

1. A graphical application system, comprising:

a surface spattering device, including;

at least one nozzle means for expelling a spattering material onto a target surface;

a nozzle control mechanism to control characteristics of the expelling of the at least one nozzle means; and

a spattering material supply;

a spatial referencing unit to reference the surface spattering device in space for determining a position and orientation of the surface spattering device;

a computation means to automatically control the expelling by the nozzle control mechanism according to information gained by the spatial referencing unit and according to predefined desired spattering data as a digital image or a CAD-model comprising a digital representation of a desired pattern to be spattered onto the target surface, in such a way that the target surface is spattered according to the desired spattering data; and

a communication means for establishing a communication link from the spatial referencing unit to the computation means to supply the position and orientation to the computation means, wherein;

the spatial referencing unit is located remote from the surface spattering device and includes a 3D imaging unit with;

at least two optical 2D cameras arranged with a stereobasis in between the cameras, the 3D imaging unit being designed for determining the position and orientation of the surface spattering device by digital image processing of images taken by the cameras,

an identification means built to identify a visual feature in the images;

a measuring means built to determine picture coordinates of the visual feature; and

a 3D modeling means built to determine position and orientation according to the picture coordinates and geometrical constraints given by the stereobasis,

wherein the determination of the spatial reference is done in at least five degrees of freedom.

2. A graphical application system as claimed in claim 1, wherein the spattering device includes:

a first set of visual features which is built in such a way, that the position and orientation of the surface spattering device is determinable by the spatial referencing unit, wherein the visual features are objects of known geometrical shape which are attached to the surface spattering device as reference marks, and wherein the first set of visual features is actively emitting optical radiation.

3. A graphical application system as claimed in claim 1 wherein a second set of visual features is located at the target surface, wherein the visual features are objects of known geometrical shape which are attached to the target surface as reference marks.

4. A graphical application system as claimed in claim 3, wherein the second visual features at the target surface are projected light marks, which are projected from a location with a fixed position relative to the target surface and which location is dislodged from the spatial referencing unit.

5. A graphical application system as claimed in claim 1, wherein the surface spattering device includes an inertial measurement unit that is incorporated in the position and orientation determination when the spatial referencing unit is temporary malfunctioning because of an obstruction of a cameras field of view.

6. A graphical application system as claimed in claim 1, wherein the surface spattering device includes:

additional sensor means for determining target surface properties and environmental conditions, spattered and non-spattered areas, present spattering thickness, present surface colour, whereof a drying condition of the spattering material is determined and incorporated in the control of the expelling characteristics; and

/or

a distance meter for evaluating a distance between the at least one nozzle means and the target surface.

7. A graphical application system as claimed in claim 1, wherein:

the application system is built for spattering non-flat, curved free form target surface according to the desired spattering data.

8. A graphical application system as claimed in claim 1, wherein:

the application system is built for spattering non-flat, curved free form target surface according to the desired spattering data for bodies of vehicles such as cars or aeroplanes and the desired spattering data comprises a three dimensional model of the target surface.

9. A graphical application system as claimed in claim 1, wherein the surface spattering device includes a positioning unit for a positioning of the at least one nozzle means in at least two degrees of freedom, with respect to a body of the surface spattering device, which body comprises means to be temporarily fixed in its position relative to the target surface.

10. A graphical application system as claimed in claim 9, wherein the body is equipped with the visual features for the spatial referencing unit and the body is referenced to the target by the spatial referencing unit and the at least one nozzle means is referenced to the body by the positioning unit for an indirect/mediated referencing of the at least one nozzle means to the target surface.

11. A graphical application system as claimed in claim 9, wherein the at least one nozzle means is equipped with the visual features for the spatial referencing unit and the at least one nozzle means is directly referenced to the target by the spatial referencing unit.

12. A graphical application system as claimed in claim 1, wherein the surface spattering device is handheld and comprises the visual features built in such a way to achieve a uniquely identifiable spatial reference of the surface spattering device by the spatial referencing unit.

13. A graphical application system as claimed in claim 1, wherein the spatial referencing unit references the surface spattering device in space relative to the target surface for determining a position and orientation of the surface spattering device.

14. A graphical application system as claimed in claim 1, further comprising a computer program product comprising program code stored on a machine-readable medium, that when executed by a computer causes the computer to perform the method comprising:

computing the desired expelling characteristics of at least one nozzle means required to spatter a target surface by at least one layer of one or more spattering materials, resulting in a spattering of the target surface according to a desired spattering data by commanding a nozzle control mechanism which is capable of adjusting the expelling characteristics of the at least one nozzle means, and based on spatial referencing data of the at least one nozzle means relative to the target surface.

15. A computer program product as claimed in claim 14, wherein method is performed on a handheld spattering device.