Socialized Mobile Photography

• US 20140354768A1
• Filed: 05/30/2013
• Published: 12/04/2014
• Est. Priority Date: 05/30/2013
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mei, Tao, Li, Shipeng, Chen, Chang Wen, Yin, Wenyuan
• Application Number:
  US13/905,347
• Publication Number:
  US 20140354768A1
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene

Abstract

A system, method or computer readable storage device to enable mobile devices in capturing high quality photos by using both the rich context available from mobile devices and crowd-sourced social media on the Web. Considering the flexible and adaptive adoption of photography principles with different content and context composition rules and exposure principles are learned from the community-contributed images. Leveraging a mobile device user'"'"'s scene context and social context, the proposed socialized mobile photography system is able to suggest optimal view enclosure to achieve appealing composition. Due to the complex scene content and a number of shooting-related contexts to exposure parameters, exposure learning is applied to suggest appropriate camera parameters.

Claims

1. A method comprising:

receiving from a mobile device an image to be captured by the mobile device and corresponding scene context;

analyzing a set of images;

performing crowd-sourced learning using a social context and the scene context associated with the set of images as well as content of the set of images; and

determining a composition suggestion and parameter suggestion for the image based at least in part on the content, the scene context and the social context.

2. The method of claim 1, wherein the image comprises a scene being captured with the mobile device.

3. The method of claim 2, wherein the mobile device comprises at least one of a cellular phone, tablet computer, or a digital camera.

4. The method of claim 1 further comprises transmitting the composition suggestion and parameter suggestion to the mobile device.

5. The method of claim 1, wherein the receiving from the mobile device comprises receiving multiple consecutive images to be synthesized into a panorama image.

6. The method of claim 1, wherein the performing the crowd-sourced learning comprises ranking the view cluster and learning an exposure metric, wherein the exposure metric is based at least in part on a lighting condition.

7. The method of claim 1, wherein the parameter suggestion is determined online while the image is being captured.

8. The method of claim 1, wherein the determining the composition suggestion comprises generating a view enclosure based at least in part on one or more candidate views.

9. The method of claim 1 further comprising adjusting one or more values of the parameter suggestion.

10. A system comprising:

one or more processors;

a memory, accessible by the one or more processors;

an input image module stored in the memory and executable on the one or more processors to receive an image and associated context information;

a learning module stored in the memory and executable on the one or more processors to mine composition and exposure rules;

a suggestion module stored in the memory and executable on the one or more processors to determine and provide a composition suggestion and a parameter suggestion; and

a transmitting module stored in the memory and executable on the one or more processors to provide the composition suggestion and parameter suggestion to aid in the capturing of the image.

11. The system of claim 10, wherein the associated context information includes at least one of geo-location information, time-of-day, weather, exposure time, aperture, and ISO information.

12. The system of claim 10, wherein the learning module uses content, scene context and social context.

13. The system of claim 12 wherein the social context includes at least one of number of view, number of favorites, tag information, comments and explicit ratings.

14. The system of claim 10, wherein the suggestion module determines a view enclosure associated with composition suggestion and a value associated with the parameter suggestion.

15. The system of claim 14, wherein the value includes at least one of ISO, Aperture, and exposure time.

16. A computer-readable storage device storing a plurality of executable instructions configured to program a computing device to perform operations comprising:

receiving an image and corresponding scene context;

analyzing a set of photographs;

performing crowd-sourced learning using a social context and scene context associated with the set of photographs; and

determining a composition suggestion and parameter suggestion for the image based at least in part on the scene context and the social context.

17. The device of claim 16, wherein the operations further comprise capturing the image according to the composition suggestion and the parameter suggestion.

18. The device of claim 16, wherein the performing the crowd-sourced learning comprises ranking the view cluster and learning an exposure metric.

19. The device of claim 16, wherein the operations further comprising adjusting a view enclosure and adjusting one or more values of the parameter suggestion.

20. The device of claim 16, wherein the determining the composition suggestion and the parameter suggestion comprises generating a view enclosure.