Devices and methods for capturing and interacting with enhanced digital images

• US 10,841,484 B2
• Filed: 08/07/2019
• Issued: 11/17/2020
• Est. Priority Date: 06/07/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Penha, Henrique D., Bauer, Sebastian J., Chaudhri, Imran A., Clarke, Graham R., Dye, Alan C., Federighi, Craig M., Foss, Christopher P., Ive, Jonathan, King, Nicholas V., Kocienda, Kenneth L., Manzari, Behkish J., Pivonka, Pavel, Preston, Daniel T., Mezak, Charles A., Titi, Justin S., Gobera Rubalcava, Daniel E.
• Primary Examiner(s): Dagnew, Mekonnen D
• Application Number:
  US16/534,214
• Publication Number:
  US 20190364194A1
• Time in Patent Office: 468 Days
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/634 Warning indications

Abstract

An electronic device displays a representative image. While displaying the representative image, the device detects a first input. In response to the first input, the device transitions from displaying the representative image to displaying a respective image that was acquired by a camera before acquiring the representative image. After transitioning from displaying the representative image to displaying the respective image, the device displays, in sequence starting with the respective image, at least some images acquired by the camera before acquiring the representative image and at least some of images acquired by the camera after acquiring the representative image. The device detects termination of the first input. In response to detecting termination of the first input, the device displays the representative image.

Claims

1. A method for displaying images, comprising:

at an electronic device with a display, and a touch-sensitive surface;

displaying a representative image on the display, wherein;

the representative image is one image in a sequence of images taken by a camera;

the sequence of images includes one or more images acquired by the camera after acquiring the representative image; and

the sequence of images includes one or more images acquired by the camera before acquiring the representative image;

while displaying the representative image on the display, detecting a first portion of a first input; and

,

in response to detecting the first portion of the first input;

transitioning from displaying the representative image to displaying a respective prior image in the sequence of images, wherein the respective prior image was acquired by the camera before acquiring the representative image; and

,

after transitioning from displaying the representative image to displaying the respective prior image, displaying, in sequence starting with the respective prior image, at least some of the one or more images acquired by the camera before acquiring the representative image and at least some of the one or more images acquired by the camera after acquiring the representative image;

detecting termination of the first input; and

in response to detecting termination of the first input, displaying the representative image.

2. The method of claim 1, wherein transitioning from displaying the representative image to displaying the respective prior image includes displaying, in sequence, at least some of the one or more images acquired by the camera after acquiring the representative image and then replacing display of a respective subsequent image acquired after acquiring the representative image with the respective prior image.

3. The method of claim 1, wherein transitioning from displaying the representative image to displaying the respective prior image includes replacing display of the representative image with the respective prior image.

4. The method of claim 1, wherein transitioning from displaying the representative image to displaying the respective prior image includes:

in accordance with a determination that the first portion of the first input meets first playback criteria, displaying, in sequence, at least some of the one or more images acquired by the camera after acquiring the representative image and then replacing display of a respective subsequent image acquired after acquiring the representative image with the respective prior image; and

,

in accordance with a determination that the first portion of the first input meets second playback criteria, different from the first playback criteria, replacing display of the representative image with the respective prior image.

5. The method of claim 4, wherein:

the electronic device includes one or more sensors to detect intensities of contacts with the touch-sensitive surface;

the first input includes a contact on the touch-sensitive surface;

the first playback criteria include a criterion that is met when the contact has a characteristic intensity above a first intensity threshold; and

the second playback criteria include a criterion that is met when the contact has a characteristic intensity above a second intensity threshold that is greater than the first intensity threshold.

6. The method of claim 1, wherein the first input is a press-and-hold gesture.

7. The method of claim 1, wherein the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image are displayed, in sequence starting with the respective prior image, at a fixed rate.

8. The method of claim 1, including:

presenting audio that corresponds to the sequence of images.

9. The method of claim 1, including:

after detecting the first portion of the first input, detecting a second portion of the first input; and

in response to detecting the second portion of the first input, displaying, in sequence, at least some of the one or more images acquired by the camera before acquiring the representative image and at least some of the one or more images acquired by the camera after acquiring the representative image.

10. The method of claim 9, including:

in response to detecting the second portion of the first input, displaying metadata that corresponds to the sequence of images.

11. The method of claim 1, wherein:

the termination of the first input is detected while displaying a first image in the sequence of images; and

,

the method includes;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that the first image occurs before the representative image in the sequence of images, sequentially displaying, in chronological order, images from the first image to the representative image, and

in accordance with a determination that the first image occurs after the representative image in the sequence of images, sequentially displaying, in reverse-chronological order, images from the first image to the representative image.

12. The method of claim 1, wherein:

the sequence of images is configured to be sequentially displayed in a loop in either a forward direction or a reverse direction;

the termination of the first input is detected while displaying a first image in the sequence of images; and

,

the method includes;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that there are fewer images between the first image and the representative image when the loop is traversed in the forward direction, sequentially displaying images from the first image to the representative image in the forward direction, and

in accordance with a determination that there are fewer images between the first image and the representative image when the loop is traversed in the reverse direction, sequentially displaying images from the first image to the representative image in the reverse direction.

13. An electronic device, comprising:

one or more processors;

a display configured to display images;

a touch-sensitive surface configured to detect user inputs; and

memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for;

displaying a representative image on the display, wherein;

the representative image is one image in a sequence of images taken by a camera;

the sequence of images includes one or more images acquired by the camera after acquiring the representative image; and

the sequence of images includes one or more images acquired by the camera before acquiring the representative image;

while displaying the representative image on the display, detecting a first portion of a first input; and

,

in response to detecting the first portion of the first input;

transitioning from displaying the representative image to displaying a respective prior image in the sequence of images, wherein the respective prior image was acquired by the camera before acquiring the representative image; and

,

after transitioning from displaying the representative image to displaying the respective prior image, displaying, in sequence starting with the respective prior image, at least some of the one or more images acquired by the camera before acquiring the representative image and at least some of the one or more images acquired by the camera after acquiring the representative image;

detecting termination of the first input; and

in response to detecting termination of the first input, displaying the representative image.

14. The electronic device of claim 13, wherein transitioning from displaying the representative image to displaying the respective prior image includes displaying, in sequence, at least some of the one or more images acquired by the camera after acquiring the representative image and then replacing display of a respective subsequent image acquired after acquiring the representative image with the respective prior image.

15. The electronic device of claim 13, wherein transitioning from displaying the representative image to displaying the respective prior image includes replacing display of the representative image with the respective prior image.

16. The electronic device of claim 13, wherein transitioning from displaying the representative image to displaying the respective prior image includes:

in accordance with a determination that the first portion of the first input meets first playback criteria, displaying, in sequence, at least some of the one or more images acquired by the camera after acquiring the representative image and then replacing display of a respective subsequent image acquired after acquiring the representative image with the respective prior image; and

,

in accordance with a determination that the first portion of the first input meets second playback criteria, different from the first playback criteria, replacing display of the representative image with the respective prior image.

17. The electronic device of claim 16, wherein:

the electronic device includes one or more sensors to detect intensities of contacts with the touch-sensitive surface;

the first input includes a contact on the touch-sensitive surface;

the first playback criteria include a criterion that is met when the contact has a characteristic intensity above a first intensity threshold; and

the second playback criteria include a criterion that is met when the contact has a characteristic intensity above a second intensity threshold that is greater than the first intensity threshold.

18. The electronic device of claim 13, wherein the first input is a press-and-hold gesture.

19. The electronic device of claim 13, wherein the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image are displayed, in sequence starting with the respective prior image, at a fixed rate.

20. The electronic device of claim 13, including:

presenting audio that corresponds to the sequence of images.

21. The electronic device of claim 13, including:

after detecting the first portion of the first input, detecting a second portion of the first input; and

in response to detecting the second portion of the first input, displaying, in sequence, at least some of the one or more images acquired by the camera before acquiring the representative image and at least some of the one or more images acquired by the camera after acquiring the representative image.

22. The electronic device of claim 21, including:

in response to detecting the second portion of the first input, displaying metadata that corresponds to the sequence of images.

23. The electronic device of claim 13, wherein:

the termination of the first input is detected while displaying a first image in the sequence of images; and

,

the one or more programs include instructions for;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that the first image occurs before the representative image in the sequence of images, sequentially displaying, in chronological order, images from the first image to the representative image, and

in accordance with a determination that the first image occurs after the representative image in the sequence of images, sequentially displaying, in reverse-chronological order, images from the first image to the representative image.

24. The electronic device of claim 13, wherein:

the sequence of images is configured to be sequentially displayed in a loop in either a forward direction or a reverse direction;

the termination of the first input is detected while displaying a first image in the sequence of images; and

,

the one or more programs include instructions for;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that there are fewer images between the first image and the representative image when the loop is traversed in the forward direction, sequentially displaying images from the first image to the representative image in the forward direction, and

in accordance with a determination that there are fewer images between the first image and the representative image when the loop is traversed in the reverse direction, sequentially displaying images from the first image to the representative image in the reverse direction.

25. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch-sensitive surface configured to detect user inputs, memory, and one or more processors, cause the electronic device to:

display a representative image on the display, wherein;

the representative image is one image in a sequence of images taken by a camera;

the sequence of images includes one or more images acquired by the camera after acquiring the representative image; and

the sequence of images includes one or more images acquired by the camera before acquiring the representative image;

while displaying the representative image on the display, detect a first portion of a first input; and

,

in response to detecting the first portion of the first input;

transition from displaying the representative image to displaying a respective prior image in the sequence of images, wherein the respective prior image was acquired by the camera before acquiring the representative image; and

,

after transitioning from displaying the representative image to displaying the respective prior image, display, in sequence starting with the respective prior image, at least some of the one or more images acquired by the camera before acquiring the representative image and at least some of the one or more images acquired by the camera after acquiring the representative image;

detect termination of the first input; and

in response to detecting termination of the first input, display the representative image.

26. The non-transitory computer readable storage medium of claim 25, wherein transitioning from displaying the representative image to displaying the respective prior image includes displaying, in sequence, at least some of the one or more images acquired by the camera after acquiring the representative image and then replacing display of a respective subsequent image acquired after acquiring the representative image with the respective prior image.

27. The non-transitory computer readable storage medium of claim 25, wherein transitioning from displaying the representative image to displaying the respective prior image includes replacing display of the representative image with the respective prior image.

28. The non-transitory computer readable storage medium of claim 25, wherein transitioning from displaying the representative image to displaying the respective prior image includes:

in accordance with a determination that the first portion of the first input meets first playback criteria, displaying, in sequence, at least some of the one or more images acquired by the camera after acquiring the representative image and then replacing display of a respective subsequent image acquired after acquiring the representative image with the respective prior image; and

,

in accordance with a determination that the first portion of the first input meets second playback criteria, different from the first playback criteria, replacing display of the representative image with the respective prior image.

29. The non-transitory computer readable storage medium of claim 28, wherein:

the electronic device includes one or more sensors to detect intensities of contacts with the touch-sensitive surface;

the first input includes a contact on the touch-sensitive surface;

the first playback criteria include a criterion that is met when the contact has a characteristic intensity above a first intensity threshold; and

the second playback criteria include a criterion that is met when the contact has a characteristic intensity above a second intensity threshold that is greater than the first intensity threshold.

30. The non-transitory computer readable storage medium of claim 25, wherein the first input is a press-and-hold gesture.

31. The non-transitory computer readable storage medium of claim 25, wherein the one or more images acquired by the camera before acquiring the representative image and the one or more images acquired by the camera after acquiring the representative image are displayed, in sequence starting with the respective prior image, at a fixed rate.

32. The non-transitory computer readable storage medium of claim 25, including:

presenting audio that corresponds to the sequence of images.

33. The non-transitory computer readable storage medium of claim 25, including:

after detecting the first portion of the first input, detecting a second portion of the first input; and

in response to detecting the second portion of the first input, displaying, in sequence, at least some of the one or more images acquired by the camera before acquiring the representative image and at least some of the one or more images acquired by the camera after acquiring the representative image.

34. The non-transitory computer readable storage medium of claim 33, including:

in response to detecting the second portion of the first input, displaying metadata that corresponds to the sequence of images.

35. The non-transitory computer readable storage medium of claim 25, wherein:

the termination of the first input is detected while displaying a first image in the sequence of images; and

,

the one or more programs include instructions which when executed by the electronic device, cause the electronic device to;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that the first image occurs before the representative image in the sequence of images, sequentially display, in chronological order, images from the first image to the representative image, and

in accordance with a determination that the first image occurs after the representative image in the sequence of images, sequentially display, in reverse-chronological order, images from the first image to the representative image.

36. The non-transitory computer readable storage medium of claim 25, wherein:

the sequence of images is configured to be sequentially displayed in a loop in either a forward direction or a reverse direction;

the termination of the first input is detected while displaying a first image in the sequence of images; and

,

the one or more programs include instructions for;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that there are fewer images between the first image and the representative image when the loop is traversed in the forward direction, sequentially display images from the first image to the representative image in the forward direction, and

in accordance with a determination that there are fewer images between the first image and the representative image when the loop is traversed in the reverse direction, sequentially display images from the first image to the representative image in the reverse direction.