Surface appearance simulation

• US 9,767,599 B2
• Filed: 12/29/2006
• Issued: 09/19/2017
• Est. Priority Date: 12/29/2006
• Status: Active Grant

• Current Assignee: X-Rite Incorporated (Danaher Corporation)
• Original Assignee: X-Rite Incorporated (Danaher Corporation)
• Inventors: Lamy, Francis, Nisper, Jon Kenneth
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US11/617,880
• Publication Number:
  US 20080158239A1
• Time in Patent Office: 3,917 Days
• Field of Search: 345418-618
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: H05K 999/99 dummy group

Abstract

A processor-based device for displaying simulated or modeled surface appearances based on surface color and surface texture data stored in a data storage. By selecting different combinations of color and texture, different surface appearances may be modeled and displayed. Also, the device may comprise an orientation sensor. Accordingly, the device may additionally consider the orientation of the device when generating surface appearances.

Claims

1. A system for generating and displaying a modeled appearance of a surface of interest on an electronic visual display device, the system comprising:

a display device;

an illumination sensor;

an orientation sensor adapted to sense at least one of the roll, pitch or yaw of the display device; and

a processor in communication with the illumination sensor, the orientation sensor and the display device, the processor programmed to;

derive an ambient illumination condition of one or more real illumination sources for the display device from an output of the illumination sensor;

derive an orientation of the display device from an output of the orientation sensor; and

generate modeled appearance data for the surface of interest based at least in part on an average BRDF of the surface comprising a color selected from a pre-existing color library, the ambient illumination condition of the display device, and on the orientation of the display device;

wherein the display device receives modeled appearance data for the surface of interest from the processor and displays the modeled appearance of the surface of interest.

2. The system of claim 1, wherein the ambient illumination condition includes a condition selected from the group consisting of Lux level, ambient spectral content and dominant illumination direction.

3. The system of claim 1, wherein the processor is further programmed to regenerate the modeled appearance data for the surface in response to a change in the ambient illumination condition.

4. The system of claim 1, further comprising a vantage point sensor for sensing a viewer relative to the display device, wherein the processor is in communication with the vantage point sensor and is further programmed to derive a vantage point location of the viewer relative to the display device from an output of the vantage point sensor.

5. The system of claim 4, wherein deriving a vantage point location of the viewer comprises locating an eye of the viewer.

6. The system of claim 4, wherein the processor is further configured to regenerate the modeled appearance data for the surface in response to a change in the vantage point location.

7. The system of claim 1, wherein the processor is further programmed to regenerate the modeled appearance data for the surface in response to a change in the output of the orientation sensor.

8. The system of claim 1, wherein the display device is a reflective display.

9. The system of claim 1, further comprising an enclosure housing the processor and the display.

10. The system of claim 1,

wherein the processor is further programmed to:

calculate a plurality of Bidirectional Reflectance Distribution Functions (BRDF'"'"'s) for the surface of interest, wherein each of the plurality of the BRDF'"'"'s correspond to one of a plurality of points positioned on the surface, with the plurality of BRDF'"'"'s being based at least in part on the orientation of the device, and being communicated to the display device.

11. The system of claim 1, further comprising data storage that stores a color database containing a plurality of surface colors and a texture database containing a plurality of surface textures;

wherein the at least one surface property includes texture data describing at least one of the surface textures selected from the texture database and color data describing at least one of the surface colors selected from the color database.

12. The system of claim 1, wherein the display device is an emissive display.

13. The system of claim 1, wherein the display device is an transparent display device.

14. The system of claim 13, wherein the display device displays additive or subtractive properties relative to an surface visible through the transparent display.

15. The system of claim 1, wherein the display device includes a texture plaque.

16. The system of claim 1, wherein the orientation sensor is adapted to measure at least two of the roll, pitch and yaw of the display device.

17. The system of claim 1, wherein the orientation sensor is adapted to measure all of the roll, pitch and yaw of the display device.

18. The system of claim 1, wherein the display device is a flexible display.

19. The system of claim 1, wherein the display device is part of a computing device capable of functioning independently of the processor, but with the processor connected in communication in with the computing device being configured to transfer modeled appearance data for the surface to the computing device for being shown on the display device.

20. The system of claim 1, wherein the processor is further programmed to select and display a color that is a dyadic complementary color to the modeled appearance of the surface of interest.

21. The system of claim 1, wherein the processor is further programmed to select and display colors that comprise triadic complementary colors to the modeled appearance of the surface of interest.

22. The system of claim 1, wherein the processor is further programmed to render the modeled appearance of the surface of interest such that it appears as if it were interacting with one or more of the real illuminations sources.

23. The system of claim 1, wherein the processor is further programmed to render the modeled appearance of the surface of interest such that it cancels out the one or more real illuminations sources.

24. A system for generating and displaying a modeled appearance of a surface of interest on an electronic visual display device, the system comprising:

a display device;

a database comprising a pre-existing color library;

a surface measurement device configured to measure a color and a texture of a surface of interest, and

a processor programmed to;

communicate with the surface measurement device and the display device, and

generate modeled appearance data for the surface of interest based at least in part on (i) an average BRDF comprising a color selected from the pre-existing color library that corresponds to the measured the color, (ii) the texture of the surface of interest, and (iii) at least one environmental factor for the display device;

wherein the display device receives modeled appearance data for the surface of interest from the processor and displays the modeled appearance of the surface of interest.

25. The system of claim 24, wherein the surface measurement device comprises at least one device selected from the group consisting of a spectrophotometer, a colorimeter, a flatbed scanner, a laser surface scanner, a simple camera, a hyperspectral cameras, and an artificial retina.

26. The system of claim 24, further comprising an orientation sensor, and wherein the at least one environmental factor comprises at least one value derived from an output of an orientation sensor associated with the system.

27. The system of claim 24, further comprising an enclosure housing the processor and the display device.

28. The system of claim 27, wherein the enclosure further houses the surface measurement device.

29. The system of claim 24, wherein the environmental factor is an orientation of the display device.

30. The system of claim 24, wherein the environment factor is an ambient illumination factor of the display device.

31. The system of claim 24, wherein the environmental factor is a vantage point of a viewer relative to the display device.