User interface for camera effects

• US 10,136,048 B2
• Filed: 12/29/2017
• Issued: 11/20/2018
• Est. Priority Date: 06/12/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Manzari, Behkish J., Bereza, Marek, Pivo{hacek over (n)}ka, Pavel
• Primary Examiner(s): Haliyur, Padma
• Application Number:
  US15/858,175
• Publication Number:
  US 20180146132A1
• Time in Patent Office: 326 Days
• CPC Class Codes: G03B 2205/00 Adjustment of optical system relative to image or object surface other than for focusing
• CPC Class Codes: G03B 2217/002 Details of arrangement of components in or on camera body
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04142 the force sensing means being located peripherally, e.g. disposed at the corners or at the side of a touch sensing plate
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: H04M 1/0264 for a camera module assembly
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/61 : based on recognised objects
• CPC Class Codes: H04N 23/611 : where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/632 : for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/634 : Warning indications
• CPC Class Codes: H04N 23/635 : Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 : Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/65 : Control of camera operation in relation to power supply
• CPC Class Codes: H04N 23/651 : for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/667 : Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/67 : Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/675 : comprising setting of focusing regions
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/695 : Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 23/959 : by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
• CPC Class Codes: H04N 5/262 : Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: H04N 5/2628 : Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

The present disclosure generally relates to user interfaces. In some examples, the electronic device transitions between user interfaces for capturing photos based on data received from a first camera and a second camera. In some examples, the electronic device provides enhanced zooming capabilities that result in visual pleasing results for a displayed digital viewfinder and for captured videos. In some examples, the electronic device provides user interfaces for transitioning a digital viewfinder between a first camera with an applied digital zoom to a second camera with no digital zoom. In some examples, the electronic device prepares to capture media at various magnification levels. In some examples, the electronic device enhanced capabilities for navigating through a plurality of values.

Claims

1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a first camera, a second camera, and a display, the one or more programs including instructions for:

concurrently displaying, on the display;

a user interface for capturing photos based on data received from the first camera that includes displaying a digital viewfinder with a first magnification; and

an affordance for modifying the magnification of photos captured by the device using one or more of the first and second cameras;

detecting activation of the affordance;

in response to detecting activation of the affordance;

ceasing to display, on the display, the user interface for capturing photos based on data received from the first camera; and

displaying, on the display, a user interface for capturing photos based on data received from the second camera that includes displaying a digital viewfinder with a second magnification that is greater than the first magnification.

2. The non-transitory computer-readable storage medium of claim 1, the one or more programs further including instructions for:

detecting a user input in the digital viewfinder;

in response to detecting the user input;

displaying, on the display, a zoom control; and

performing a zoom of the digital viewfinder in accordance with the user input.

3. The non-transitory computer-readable storage medium of claim 2, wherein the user input corresponds to a pinch gesture in the digital viewfinder.

4. The non-transitory computer-readable storage medium of claim 2, wherein the user input corresponds to a drag gesture in the digital viewfinder.

5. The non-transitory computer-readable storage medium of claim 2, wherein the user input corresponds to a swipe gesture in the digital viewfinder.

6. The non-transitory computer-readable storage medium of claim 2, wherein the zoom control includes a zoom indicator affordance.

7. The non-transitory computer-readable storage medium of claim 6, wherein the zoom control includes a plurality of locations corresponding to a plurality of magnification levels, and wherein a first location of the plurality of locations corresponds to a first optical magnification level and a second location of the plurality of locations corresponds to a second optical magnification level that is different from the first optical magnification level.

8. The non-transitory computer-readable storage medium of claim 2, the one or more programs further including instructions for:

detecting a gesture corresponding to the zoom control, the gesture having a direction and a length;

in response to detecting the gesture corresponding to the zoom control and in accordance with the direction being a first direction, performing a zoom-out of the digital viewfinder at a speed based on the magnitude of the gesture; and

in response to detecting the gesture corresponding to the zoom control and in accordance with the direction being a second direction different from the first direction, performing a zoom-in of the digital viewfinder at a speed based on the magnitude of the gesture.

9. The non-transitory computer-readable storage medium of claim 1, wherein the affordance for modifying the magnification is displayed in accordance with a determination that the electronic device includes a plurality of cameras with overlapping fields of view.

10. The non-transitory computer-readable storage medium of claim 1, the one or more programs further including instructions for:

detecting a second activation of the affordance for modifying the magnification;

in response to detecting the second activation of the affordance for modifying the magnification;

ceasing to display, on the display, the user interface for capturing photos based on data received from the second camera; and

displaying, on the display, the user interface for capturing photos based on data received from the first camera that includes displaying the digital viewfinder with the first magnification.

11. The non-transitory computer-readable storage medium of claim 2, wherein the displayed zoom control fades out in response to detecting an input lift-off signal associated with the user input in the digital viewfinder and wherein the displayed affordance for modifying the magnification does not fade out in response detecting the input lift-off signal associated with the user input in the digital viewfinder.

12. The non-transitory computer-readable storage medium of claim 2, wherein displaying, on the display, the zoom control includes replacing display of the affordance for modifying the magnification with display of the zoom control.

13. A method, comprising:

at an electronic device with a first camera, a second camera, and a display;

concurrently displaying, on the display;

a user interface for capturing photos based on data received from the first camera that includes displaying a digital viewfinder with a first magnification; and

an affordance for modifying the magnification of photos captured by the device using one or more of the first and second cameras;

detecting activation of the affordance;

in response to detecting activation of the affordance;

ceasing to display, on the display, the user interface for capturing photos based on data received from the first camera; and

displaying, on the display, a user interface for capturing photos based on data received from the second camera that includes displaying a digital viewfinder with a second magnification that is greater than the first magnification.

15. The method of claim 13, further comprising:

detecting a user input in the digital viewfinder;

in response to detecting the user input;

displaying, on the display, a zoom control; and

performing a zoom of the digital viewfinder in accordance with the user input.

16. The method of claim 15, wherein the user input corresponds to a pinch gesture in the digital viewfinder.

17. The method of claim 15, wherein the user input corresponds to a drag gesture in the digital viewfinder.

18. The method of claim 15, wherein the user input corresponds to a swipe gesture in the digital viewfinder.

19. The method of claim 15, wherein the zoom control includes a zoom indicator affordance.

20. The method of claim 19, wherein the zoom control includes a plurality of locations corresponding to a plurality of magnification levels, and wherein a first location of the plurality of locations corresponds to a first optical magnification level and a second location of the plurality of locations corresponds to a second optical magnification level that is different from the first optical magnification level.

21. The method of claim 15, further comprising:

detecting a gesture corresponding to the zoom control, the gesture having a direction and a length;

in response to detecting the gesture corresponding to the zoom control and in accordance with the direction being a first direction, performing a zoom-out of the digital viewfinder at a speed based on the magnitude of the gesture; and

in response to detecting the gesture corresponding to the zoom control and in accordance with the direction being a second direction different from the first direction, performing a zoom-in of the digital viewfinder at a speed based on the magnitude of the gesture.

22. The method of claim 13, wherein the affordance for modifying the magnification is displayed in accordance with a determination that the electronic device includes a plurality of cameras with overlapping fields of view.

23. The method of claim 13, further comprising:

detecting a second activation of the affordance for modifying the magnification;

in response to detecting the second activation of the affordance for modifying the magnification;

ceasing to display, on the display, the user interface for capturing photos based on data received from the second camera; and

displaying, on the display, the user interface for capturing photos based on data received from the first camera that includes displaying the digital viewfinder with the first magnification.

24. The method of claim 15, wherein the displayed zoom control fades out in response to detecting an input lift-off signal associated with the user input in the digital viewfinder and wherein the displayed affordance for modifying the magnification does not fade out in response detecting the input lift-off signal associated with the user input in the digital viewfinder.

25. The method of claim 15, wherein displaying, on the display, the zoom control includes replacing display of the affordance for modifying the magnification with display of the zoom control.

14. An electronic device, comprising:

a first camera;

a second camera;

a display;

one or more processors; and

a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

concurrently displaying, on the display;

a user interface for capturing photos based on data received from the first camera that includes displaying a digital viewfinder with a first magnification; and

an affordance for modifying the magnification of photos captured by the device using one or more of the first and second cameras;

detecting activation of the affordance;

in response to detecting activation of the affordance;

ceasing to display, on the display, the user interface for capturing photos based on data received from the first camera; and

displaying, on the display, a user interface for capturing photos based on data received from the second camera that includes displaying a digital viewfinder with a second magnification that is greater than the first magnification.

26. The electronic device of claim 14, the one or more programs further including instructions for:

detecting a user input in the digital viewfinder;

in response to detecting the user input;

displaying, on the display, a zoom control; and

performing a zoom of the digital viewfinder in accordance with the user input.

27. The electronic device of claim 26, wherein the user input corresponds to a pinch gesture in the digital viewfinder.

28. The electronic device of claim 26, wherein the user input corresponds to a drag gesture in the digital viewfinder.

29. The electronic device of claim 26, wherein the user input corresponds to a swipe gesture in the digital viewfinder.

30. The electronic device of claim 26, wherein the zoom control includes a zoom indicator affordance.

31. The electronic device of claim 30, wherein the zoom control includes a plurality of locations corresponding to a plurality of magnification levels, and wherein a first location of the plurality of locations corresponds to a first optical magnification level and a second location of the plurality of locations corresponds to a second optical magnification level that is different from the first optical magnification level.

32. The electronic device of claim 26, the one or more programs further including instructions for:

detecting a gesture corresponding to the zoom control, the gesture having a direction and a length;

in response to detecting the gesture corresponding to the zoom control and in accordance with the direction being a first direction, performing a zoom-out of the digital viewfinder at a speed based on the magnitude of the gesture; and

in response to detecting the gesture corresponding to the zoom control and in accordance with the direction being a second direction different from the first direction, performing a zoom-in of the digital viewfinder at a speed based on the magnitude of the gesture.

33. The electronic device of claim 14, wherein the affordance for modifying the magnification is displayed in accordance with a determination that the electronic device includes a plurality of cameras with overlapping fields of view.

34. The electronic device of claim 14, the one or more programs further including instructions for:

detecting a second activation of the affordance for modifying the magnification;

in response to detecting the second activation of the affordance for modifying the magnification;

ceasing to display, on the display, the user interface for capturing photos based on data received from the second camera; and

displaying, on the display, the user interface for capturing photos based on data received from the first camera that includes displaying the digital viewfinder with the first magnification.

35. The electronic device of claim 26, wherein the displayed zoom control fades out in response to detecting an input lift-off signal associated with the user input in the digital viewfinder and wherein the displayed affordance for modifying the magnification does not fade out in response detecting the input lift-off signal associated with the user input in the digital viewfinder.

36. The electronic device of claim 26, wherein displaying, on the display, the zoom control includes replacing display of the affordance for modifying the magnification with display of the zoom control.