Method and apparatus for dynamic signage using a painted surface display system

• US 9,195,320 B1
• Filed: 10/22/2012
• Issued: 11/24/2015
• Est. Priority Date: 10/22/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Teller, Eric, Patrick, William Graham, Peeters, Eric, Lee, Johnny
• Primary Examiner(s): BALAOING, ARIEL A
• Application Number:
  US13/657,372
• Time in Patent Office: 1,128 Days
• Field of Search: 345/105
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: H04M 1/2755 by optical scanning

Abstract

A method and apparatus for generating dynamic signage using a painted surface display system is described. The method may include capturing image data with at least a camera of a painted surface display system. The method may also include analyzing the image data to determine a real-world context proximate to a painted surface, wherein the painted surface is painted with a photo-active paint. The method may also include determining electronic signage data based on the determined real-world context. The method may also include generating a sign image from the determined electronic signage data based on the determined real-world context, and driving a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of the sign image to cause the photo active paint to display the sign image.

Claims

1. A method, comprising:

capturing image data with at least a camera of a painted surface display system;

analyzing the image data to determine a real-world context proximate to a painted surface, wherein the painted surface is painted with a photo-active paint;

determining electronic signage data based on the determined real-world context;

generating a sign image from the determined electronic signage data based on the determined real-world context; and

driving a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of the sign image to cause the photo active paint to display the sign image on the painted surface,

wherein capturing the image data includes capturing image data of both the sign image displayed on the painted surface and a user located adjacent to the painted surface,

wherein analyzing the image data to determine the real-world context includes analyzing the user relative to the sign image currently displayed on the painted surface.

2. The method of claim 1, wherein the sign image displayed on the photo-active paint persists for a period of time even when the user moves into a path between the spatial electromagnetic modulator and the sign image displayed on photo-active paint.

3. The method of claim 1, wherein analyzing the image data to determine a real-world context further comprises:

performing one or more computer vision processes on the image data to identify the user within the image data; and

selecting the signage, based at least in part, on an identity of the user.

4. The method of claim 3, further comprises:

determining one or more signage preferences associated with the user; and

selecting the signage based on the one or more signage preferences.

5. The method of claim 3, further comprising:

based on the identity of the person, obtaining user authentication data associated with the user;

providing the authentication data to one or more remote service providers; and

obtaining data from the one or more remote service providers for display in the selected signage.

6. The method of claim 5, wherein the data from the one or more remote service providers includes one or more of electronic mail, a microblog, an electronic bulletin board, weather data, news data, calendar data, an image, a video, or an advertisement.

7. The method of claim 1, where selecting signage data based on the determined real-world context further comprises:

receiving tracking data indicative of signage data being displayed to the user by a second painted surface display system, wherein the tracking data includes at least data indicative of one or more sign images being displayed to the user by the second painted surface display system and data indicative of a movement of the user relative to the painted surface display system and the second painted surface display system;

receiving instructions at the painted surface display system to display the one or more sign images being displayed to the user by the second painted surface display system; and

selecting the one or more sign images for display by the painted surface display system based on the received instructions.

8. The method of claim 1, where analyzing the image data and selecting signage data further comprises:

analyzing the image data to determine signage data displayed by a second painted surface display system, the determined signage data to refine the real-world context proximate to a painted surface;

tracking the user'"'"'s location within the image data to determine a corresponding real-world location and movement of the user relative to the painted surface display system and the second painted surface display system; and

based on the real-world location and movement of the user, selecting at the painted surface display system to display the signage data displayed by the second painted surface display system with the painted surface display system.

9. The method of claim 1, wherein the selected signage data is an electronic sign to be displayed on the painted surface of a convention center.

10. The method of claim 1, wherein the selected signage data includes direction data to display real-world directions on the painted surface to direct the user to a real-world destination.

11. The method of claim 1, further comprising:

capturing sensor data with one or more sensors of the painted surface display system;

analyzing the sensor data to determine an identity of the user proximate to one or more of the painted surface or the painted surface display system; and

selecting signage data based at least in part on the determined identity of the user.

12. The method of claim 11, wherein the sensor data includes one or more of radio-frequency identification data or cell phone signal data associated with the user.

13. The method of claim 1, wherein the photo-active paint is one of a photo-luminescent material that emits visible spectrum light in response to electromagnetic stimulation or a photochromatic material that changes light absorption properties in response to the electromagnetic stimulation.

14. A non-transitory computer readable storage medium including instructions that, when executed by a processor, cause the processor to perform a method comprising:

capturing image data with at least a camera of a painted surface display system;

analyzing the image data to determine a real-world context proximate to a painted surface, wherein the painted surface is painted with a photo-active paint;

determining electronic signage data based on the determined real-world context;

generating a sign image from the determined electronic signage data based on the determined real-world context; and

driving a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of the sign image to cause the photo active paint to display the sign image on the painted surface,

wherein capturing the image data includes capturing image data of both the sign image displayed on the painted surface and a user located adjacent to the painted surface,

wherein analyzing the image data to determine the real-world context includes analyzing the user relative to the sign image currently displayed on the painted surface.

15. The non-transitory computer readable storage medium of claim 14, wherein the sign image displayed on the photo-active paint persists for a period of time even when an obstruction moves into a path between the spatial electromagnetic modulator and the sign image displayed on photo-active paint.

16. The non-transitory computer readable storage medium of claim 14, wherein analyzing the image data to determine a real-world context further comprises:

performing one or more computer vision processes on the image data to identify the user within the image data; and

selecting the signage, based at least in part, on the identity of the user.

17. The non-transitory computer readable storage medium of claim 14, where selecting signage data based on the determined real-world context further comprises:

receiving tracking data indicative of signage data being displayed to the user by a second painted surface display system, wherein the tracking data includes at least data indicative of one or more sign images being displayed to the user by the second painted surface display system and data indicative of a movement of the user relative to the painted surface display system and the second painted surface display system;

receiving instructions at the painted surface display system to display the one or more sign images being displayed to the user by the second painted surface display system; and

selecting the one or more sign images for display by the painted surface display system based on the received instructions.

18. The non-transitory computer readable storage medium of claim 14, where analyzing the image data and selecting signage data further comprises:

analyzing the image data to determine signage data displayed by a second painted surface display system, the determined signage data to refine the real-world context proximate to a painted surface;

tracking the user'"'"'s location within the image data to determine a corresponding real-world location and movement of the user relative to the painted surface display system and the second painted surface display system; and

based on the real-world location and movement of the user, selecting at the painted surface display system to display the signage data displayed by the second painted surface display system with the painted surface display system.

19. The non-transitory computer readable storage medium of claim 14, wherein the selected signage data is an electronic sign to be displayed on the painted surface of a convention center.

20. The non-transitory computer readable storage medium of claim 14, wherein the selected signage data includes direction data to display real-world directions on the painted surface to direct the user to a real-world destination.

21. The non-transitory computer readable storage medium of claim 14, further comprising:

capturing sensor data with one or more sensors of the painted surface display system;

analyzing the sensor data to determine an identity of the user proximate to one or more of the painted surface and the painted surface display system;

selecting signage data based at least in part on the determined identity of the user.

22. A painted surface display system comprising:

an audiovisual capture device to capture image data with at least a camera of a painted surface display system and a user located adjacent to a painted surface;

a user recognition and context engine to analyze the image data to determine a real-world context proximate to the painted surface, wherein the painted surface is painted with a photo-active paint;

a signage engine to determine electronic signage based on the determined real-world context; and

a display engine to generate a sign image for the determined electronic signage based on the determined real-world context, and drive a spatial electromagnetic modulator to emit electromagnetic stimulation in the form of the sign image to cause the photo active paint to display the sign image on the painted surface,

wherein the user recognition and context engine is configured to analyze the user relative to the sign image currently displayed on the painted surface when determining the real-world context.