Devices and methods for capturing and interacting with enhanced digital images

• US 9,602,729 B2
• Filed: 09/24/2015
• Issued: 03/21/2017
• Est. Priority Date: 06/07/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: King, Nicholas V., Bauer, Sebastian J., Conolly, Bethany B., Chaudhri, Imran A., Dye, Alan C., Federighi, Craig M., Ive, Jonathan, Jurewitz, Michael T., Manzari, Behkish J., Maric, Natalia C., Penha, Henrique D., Pivonka, Pavel, Preston, Daniel T.
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US14/864,627
• Publication Number:
  US 20160360098A1
• Time in Patent Office: 544 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 1/2125 Display of information relating to the still picture recording
• CPC Class Codes: H04N 1/2145 of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 : for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/634 : Warning indications
• CPC Class Codes: H04N 23/64 : Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/73 : by influencing the exposure time

Abstract

An electronic device displays a representative image. The representative image is one image in a sequence of images that includes images acquired after the representative image. While displaying the representative image, the device detects a contact with a first intensity. In response to detecting the contact, the device advances through the images acquired after the representative image at a rate based on the first intensity. When the device detects a decrease in intensity of the contact to a second intensity that is less than the first intensity, the device either continues to advance through the one or more images at a slower rate or reverses direction, depending at least in part on the second intensity relative to a threshold intensity.

Claims

1. A method, comprising:

at an electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensities contacts with the touch-sensitive surface;

displaying a representative image on the display, wherein;

the representative image is one image in a sequence of images taken by a camera; and

the sequence of images includes one or more images acquired by the camera after acquiring the representative image;

while displaying the representative image on the display, detecting a first input that includes detecting an increase in a characteristic intensity of a contact on the touch-sensitive surface to a first intensity that is greater than a first intensity threshold;

in response to detecting the increase in the characteristic intensity of the contact, advancing, in a first direction, through the one or more images acquired by the camera after acquiring the representative image at a rate that is determined based at least in part on the first intensity; and

after advancing through the one or more images acquired by the camera after acquiring the representative image at the rate that is determined based on the first intensity, detecting a decrease in intensity of the contact to a second intensity that is less than the first intensity; and

,

in response to detecting the decrease in the characteristic intensity of the contact to the second intensity;

in accordance with a determination that the second intensity is above the first intensity threshold, continuing to advance, in the first direction, through the one or more images acquired by the camera after acquiring the representative image at a second rate, wherein;

the second rate is determined based at least in part on the second intensity and

the second rate is slower than the first rate; and

,

in accordance with a determination that the second intensity is below the first intensity threshold, moving, in a second direction that is opposite to the first direction, through the one or more images acquired by the camera after acquiring the representative image at a rate that is determined based at least in part on the second intensity.

2. The method of claim 1, wherein the first rate is determined based in part on a proximity of a currently displayed image to an end of the sequence of images.

3. The method of claim 1, wherein intensity values of the characteristic intensity of the contact proximate to the first intensity threshold are associated with rate values that are at least a predetermined amount away from a rate of zero images per second.

4. The method of claim 1, wherein the rate of movement through the sequence of images is constrained by a maximum reverse rate while the contact is detected on the touch-sensitive surface, and the method includes:

detecting liftoff of the contact from the touch-sensitive surface; and

in response to detecting liftoff of the contact, moving through the images in the second direction at a rate that is greater than the maximum reverse rate.

5. The method of claim 1, wherein the images are displayed, in sequence, at a rate proportional to a difference between the characteristic intensity of the contact and the first intensity threshold.

6. The method of claim 1, including:

decreasing a rate at which images in the sequence of images are displayed as a terminus of the sequence of images is approached.

7. The method of claim 1, wherein the sequence of images includes one or more images acquired by the camera before acquiring the representative image.

8. The method of claim 1, wherein the representative image is displayed as a background image on a lock screen of a device, and one or more foreground elements are not changed while the device advances through the one or more images captured after the respective image.

9. The method of claim 1, including:

detecting termination of the first input; and

in response to detecting termination of the first input, displaying the representative image.

10. The method of claim 1, including:

detecting termination of the first input while displaying a first image in the sequence of images;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that the first image occurs before the representative image in the sequence of images, sequentially displaying, in chronological order, images from the first image to the representative image, and

in accordance with a determination that the first image occurs after the representative image in the sequence of images, sequentially displaying, in reverse-chronological order, images from the first image to the representative image.

11. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more sensors to detect intensity intensities of contacts with the touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a representative image on the display, wherein;

the representative image is one image in a sequence of images taken by a camera; and

the sequence of images includes one or more images acquired by the camera after acquiring the representative image;

while displaying the representative image on the display, detecting a first input that includes detecting an increase in a characteristic intensity of a contact on the touch-sensitive surface to a first intensity that is greater than a first intensity threshold;

in response to detecting the increase in the characteristic intensity of the contact, advancing, in a first direction, through the one or more images acquired by the camera after acquiring the representative image at a rate that is determined based at least in part on the first intensity; and

after advancing through the one or more images acquired by the camera after acquiring the representative image at the rate that is determined based on the first intensity, detecting a decrease in intensity of the contact to a second intensity that is less than the first intensity; and

,

in response to detecting the decrease in the characteristic intensity of the contact to the second intensity;

in accordance with a determination that the second intensity is above the first intensity threshold, continuing to advance, in the first direction, through the one or more images acquired by the camera after acquiring the representative image at a second rate, wherein;

the second rate is determined based at least in part on the second intensity and

the second rate is slower than the first rate; and

,

in accordance with a determination that the second intensity is below the first intensity threshold, moving, in a second direction that is opposite to the first direction, through the one or more images acquired by the camera after acquiring the representative image at a rate that is determined based at least in part on the second intensity.

13. The electronic device of claim 11, wherein the first rate is determined based in part on a proximity of a currently displayed image to an end of the sequence of images.

14. The electronic device of claim 11, wherein intensity values of the characteristic intensity of the contact proximate to the first intensity threshold are associated with rate values that are at least a predetermined amount away from a rate of zero images per second.

15. The electronic device of claim 11, wherein rate of movement through the sequence of images is constrained by a maximum reverse rate while the contact is detected on the touch-sensitive surface, and the one or more programs include instructions for:

detecting liftoff of the contact from the touch-sensitive surface; and

in response to detecting liftoff of the contact, moving through the images in the second direction at a rate that is greater than the maximum reverse rate.

16. The electronic device of claim 11, wherein the images are displayed, in sequence, at a rate proportional to a difference between the characteristic intensity of the contact and the first intensity threshold.

17. The electronic device of claim 11, wherein the one or more programs include instructions for:

decreasing a rate at which images in the sequence of images are displayed as a terminus of the sequence of images is approached.

18. The electronic device of claim 11, wherein the sequence of images includes one or more images acquired by the camera before acquiring the representative image.

19. The electronic device of claim 11, wherein the representative image is displayed as a background image on a lock screen of a device, and one or more foreground elements are not changed while the device advances through the one or more images captured after the respective image.

20. The electronic device of claim 11, wherein the one or more programs include instructions for:

detecting termination of the first input; and

in response to detecting termination of the first input, displaying the representative image.

21. The electronic device of claim 11, wherein the one or more programs include instructions for:

detecting termination of the first input while displaying a first image in the sequence of images;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that the first image occurs before the representative image in the sequence of images, sequentially displaying, in chronological order, images from the first image to the representative image, and

in accordance with a determination that the first image occurs after the representative image in the sequence of images, sequentially displaying, in reverse-chronological order, images from the first image to the representative image.

12. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with one or more processors, a display, a touch-sensitive surface, and one or more sensors to detect intensities of contacts with the touch-sensitive surface, cause the device to:

display a representative image on the display, wherein;

the representative image is one image in a sequence of images taken by a camera; and

the sequence of images includes one or more images acquired by the camera after acquiring the representative image;

while displaying the representative image on the display, detect a first input that includes detecting an increase in a characteristic intensity of a contact on the touch-sensitive surface to a first intensity that is greater than a first intensity threshold;

in response to detecting the increase in the characteristic intensity of the contact, advance, in a first direction, through the one or more images acquired by the camera after acquiring the representative image at a rate that is determined based at least in part on the first intensity; and

after advancing through the one or more images acquired by the camera after acquiring the representative image at the rate that is determined based on the first intensity, detect a decrease in intensity of the contact to a second intensity that is less than the first intensity; and

,

in response to detecting the decrease in the characteristic intensity of the contact to the second intensity;

in accordance with a determination that the second intensity is above the first intensity threshold, continue to advance, in the first direction, through the one or more images acquired by the camera after acquiring the representative image at a second rate, wherein;

the second rate is determined based at least in part on the second intensity and

the second rate is slower than the first rate; and

,

in accordance with a determination that the second intensity is below the first intensity threshold, move, in a second direction that is opposite to the first direction, through the one or more images acquired by the camera after acquiring the representative image at a rate that is determined based at least in part on the second intensity.

22. The computer readable storage medium of claim 12, wherein the first rate is determined based in part on a proximity of a currently displayed image to an end of the sequence of images.

23. The computer readable storage medium of claim 12, wherein intensity values of the characteristic intensity of the contact proximate to the first intensity threshold are associated with rate values that are at least a predetermined amount away from a rate of zero images per second.

24. The computer readable storage medium of claim 12, wherein rate of movement through the sequence of images is constrained by a maximum reverse rate while the contact is detected on the touch-sensitive surface, and the computer readable storage medium includes instructions, which when executed by the electronic device with the display, the touch-sensitive surface, and the one or more sensors, cause the electronic device to:

detect liftoff of the contact from the touch-sensitive surface; and

in response to detecting liftoff of the contact, move through the images in the second direction at a rate that is greater than the maximum reverse rate.

25. The computer readable storage medium of claim 12, wherein the images are displayed, in sequence, at a rate proportional to a difference between the characteristic intensity of the contact and the first intensity threshold.

26. The computer readable storage medium of claim 12, including instructions, which when executed by the electronic device with the display, the touch-sensitive surface, and the one or more sensors, cause the electronic device to:

decrease a rate at which images in the sequence of images are displayed as a terminus of the sequence of images is approached.

27. The computer readable storage medium of claim 12, wherein the sequence of images includes one or more images acquired by the camera before acquiring the representative image.

28. The computer readable storage medium of claim 12, wherein the representative image is displayed as a background image on a lock screen of a device, and one or more foreground elements are not changed while the device advances through the one or more images captured after the respective image.

29. The computer readable storage medium of claim 12, including instructions, which when executed by the electronic device with the display, the touch-sensitive surface, and the one or more sensors, cause the electronic device to:

detect termination of the first input; and

in response to detecting termination of the first input, display the representative image.

30. The computer readable storage medium of claim 12, including instructions, which when executed by the electronic device with the display, the touch-sensitive surface, and the one or more sensors, cause the electronic device to:

detect termination of the first input while displaying a first image in the sequence of images;

in response to detecting termination of the first input while displaying the first image in the sequence of images;

in accordance with a determination that the first image occurs before the representative image in the sequence of images, sequentially display, in chronological order, images from the first image to the representative image, and

in accordance with a determination that the first image occurs after the representative image in the sequence of images, sequentially display, in reverse-chronological order, images from the first image to the representative image.