Display adaptation based on captured image feedback

• US 8,731,301 B1
• Filed: 09/25/2008
• Issued: 05/20/2014
• Est. Priority Date: 09/25/2008
• Status: Active Grant

• Current Assignee: T-Mobile Innovations LLC (Deutsche Telekom AG)
• Original Assignee: Sprint Communications Company LP (Deutsche Telekom AG)
• Inventors: Bushman, Serge J. L., Gailloux, Michael A., Persson, Carl J., Wilson, Thomas H.
• Primary Examiner(s): Alavi, Amir
• Assistant Examiner(s): CESE, KENNY A
• Application Number:
  US12/238,148
• Time in Patent Office: 2,063 Days
• Field of Search: 700 3- 10, 705/14, 705 35- 37
• US Class Current: 382/189
• CPC Class Codes: G06V 10/225 based on a marking or identifier characterising the area
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A computer implemented method is provided for display adaptation based on captured image feedback. Content that comprises a marker is displayed. An image of the content is captured by a mobile device. Whether the marker in the image is recognized is determined. The marker in the image is analyzed in response to a determination that the marker in the image is not recognized. The content is adjusted based on the analyzed marker. The adjusted content is displayed. The marker in the image is analyzed to determine at least one of a time and a location associated with capturing the image of the content in response to a determination that the marker in the image is recognized. Another content is displayed based on at least one of the time and the location determined by analyzing the marker.

Claims

1. A computer implemented method for display adaptation based on captured image feedback, comprising:

displaying content on a digital display that comprises a content marker, wherein the digital display comprises a digital billboard, a digital bulletin, or a digital poster;

receiving an image of the content captured by a mobile device;

determining whether a marker in the received image is recognized;

analyzing the marker in the received image to identify the content marker in response to a determination that the marker in the received image is not recognized;

analyzing the marker in the received image and the identified content marker to determine why the marker in the received image was not recognized;

adjusting the content based on the analysis of the marker in the received image and the identified content marker to improve identification of the content marker in subsequently received images of the content captured by mobile devices; and

displaying the adjusted content on the digital display.

2. The computer implemented method of claim 1, wherein the content marker comprises at least one of a symmetrical pattern, an asymmetrical pattern, a moving marker, a one dimensional bar code, a two dimensional bar code, or a color light pattern.

3. The computer implemented method of claim 1, wherein analyzing the marker in the received image to identify the content marker comprises determining a relationship of the image to the content based on at least one of the content, a size of the image, a camera setting, an inferred angle for capturing the image, or an inferred distance for capturing the image.

4. The computer implemented method of claim 1, wherein analyzing the marker in the received image to identify the content marker comprises analyzing at least one of a number of determinations that the marker in the received image is not recognized or a number of determinations that the marker in the received image is recognized.

5. The computer implemented method of claim 1, wherein analyzing the marker in the received image to identify the content marker comprises identifying the content marker based on one of a location associated with capturing the image of the content and a comparison of the image of the content with an image for which the marker in the received image is recognized.

6. The computer implemented method of claim 1, wherein adjusting the content on the digital display comprises at least one of modifying a size of the content marker, modifying a background of the content, modifying a color of the content marker, modifying a brightness of the content, modifying a contrast of the content, or relocating the content marker within the content.

7. The computer implemented method of claim 1, wherein adjusting the content based on the analysis of the marker in the received image and the identified content marker comprises adjusting the content based on analysis of a plurality of markers in received images associated with the content.

8. The computer implemented method of claim 7, wherein the plurality of markers in the received images are each associated with a plurality of cameras that are identified as candidates for capturing the adjusted content to provide a future recognition of the content marker.

9. The computer implemented method of claim 1, further comprising providing a recommendation to a user for adjusting use of a camera based on analysis of the marker in the received image.

10. The computer implemented method of claim 1, further comprising enabling the mobile device associated with the marker in the received image to receive a second image of the content from another mobile device associated with recognizing the content marker in the second image.

11. The computer implemented method of claim 1, further comprising:

determining a level of activity at the server associated with processing markers in received images of the content from mobile devices;

selecting another content that comprises another content marker based on the determined level of activity; and

providing the other content that comprises the other content marker to the digital display, wherein the digital display is further configured to display the other content that comprises the other content marker.

12. The computer implemented method of claim 11, wherein the other content is selected based on a determined level of interest in the other content.

13. The computer implemented method of claim 1, further comprising:

capturing a second image of a second content by a second mobile device;

recognizing a second marker in the second image;

determining at least one of a time or a location associated with capturing the second image of the second content by analyzing the recognized marker in the second image; and

displaying a third content comprising a third marker based on the at least one of the time or the location associated with capturing the second image of the second content on the digital display.

14. The computer implemented method of claim 13, further comprising providing information to the second mobile device based on the at least one of the time and the location associated with capturing the second image of the second content.