Devices and methods for capturing and interacting with enhanced digital images

• US 9,706,127 B2
• Filed: 09/24/2015
• Issued: 07/11/2017
• Est. Priority Date: 06/07/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Langoulant, Brendan J., Manzari, Behkish J., Pivonka, Pavel, Titi, Justin S., Penha, Henrique D., Bovet, Simon, Apodaca, Gregory M., Mezak, Charles A.
• Primary Examiner(s): DAGNEW, MEKONNEN D
• Application Number:
  US14/864,601
• Publication Number:
  US 20160357387A1
• Time in Patent Office: 656 Days
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 1/2125 Display of information relating to the still picture recording
• CPC Class Codes: H04N 1/2145 of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/62 : Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 : for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/634 : Warning indications
• CPC Class Codes: H04N 23/64 : Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/73 : by influencing the exposure time

Abstract

An electronic device that includes a touch-sensitive surface stores a plurality of sequences of images. The device displays a first representative image for a first sequence of images in a movable first area on a display. The device detects a gesture on the touch-sensitive surface, the gesture including movement by a contact that corresponds to movement in a first direction on the display. In response to detecting the gesture on the touch-sensitive surface: the device moves the first area in the first direction on the display; moves a movable second area in the first direction on the display; and, in accordance with a determination that sequence-display criteria are met, displays, in chronological order in the second area, at least some images for a second sequence of images acquired by the camera before acquiring a second representative image for the second sequence of images.

Claims

1. A method, comprising:

at an electronic device with a display and a touch-sensitive surface;

storing a plurality of sequences of images, wherein a respective sequence of images includes;

a respective representative image taken by a camera, and

one or more images acquired by the camera before acquiring the respective representative image;

displaying a first representative image for a first sequence of images in a movable first area on the display;

detecting a gesture on the touch-sensitive surface, the gesture including movement by a contact that corresponds to movement in a first direction on the display;

in response to detecting the gesture on the touch-sensitive surface;

moving the first area in the first direction on the display;

moving a movable second area in the first direction on the display; and

,

in accordance with a determination that sequence-display criteria are met, while moving the second area in the first direction, displaying, in chronological order in the second area, at least some of the one or more images for a second sequence of images acquired by the camera before acquiring a second representative image for the second sequence of images.

2. The method of claim 1, including:

in response to detecting the gesture on the touch-sensitive surface;

in accordance with a determination that the sequence-display criteria are not met, while moving the second area in the first direction, displaying the second representative image for the second sequence of images in the movable second area on the display.

3. The method of claim 1, wherein the sequence-display criteria include a criterion that the contact lifts off prior to displaying, in chronological order in the second area, at least some of the one or more images for the second sequence of images acquired by the camera before acquiring the second representative image.

4. The method of claim 1, wherein moving the movable second area in the first direction on the display includes displaying a respective prior image that was acquired prior to acquiring the second representative image in the second region.

5. The method of claim 1, wherein the sequence-display criteria include detecting liftoff of the contact;

and the method includes;

in response to detecting liftoff of the contact, continuing to move the moveable second area in the first direction and continuing to move the moveable first area in the first direction, wherein the images from the second sequence of images are displayed at a rate such that the second representative image is displayed in the moveable second area when the moveable second area stops moving in the first direction.

6. The method of claim 1, including while moving the moveable first region, displaying a simulated parallax effect for an image within the moveable first region such that the image within the moveable first region shifts relative to a frame of the moveable first region.

7. The method of claim 1, including while moving the moveable second region while the contact is detected on the touch-sensitive surface, displaying a simulated parallax effect for an image within the moveable second region such that the image within the moveable second region shifts relative to a frame of the moveable second region.

8. The method of claim 1, wherein a respective sequence of images includes one or more images acquired by the camera after acquiring the respective representative image.

9. The method of claim 1, wherein moving the first area in the first direction includes moving at least part of the first area off of the display in the first direction.

10. The method of claim 1, wherein moving the second area in the first direction includes moving at least part of the second area onto the display in the first direction.

11. The method of claim 1, including, after moving the second area in the first direction, displaying the second representative image for the second sequence of images in the second area.

12. The method of claim 11, including:

while displaying the second representative image for the second sequence of images in the second area, detecting a change in intensity of an input corresponding to the second representative image; and

in response to detecting the change in intensity of the input, advancing through the second sequence of images in the second area without moving the second area on the display.

13. The method of claim 1, including:

detecting termination of the gesture while moving the first area and the second area; and

in response to detecting termination of the gesture while moving the first area and the second area;

in accordance with a determination that the gesture meets next-sequence-navigation criteria;

moving the first area completely off the display in the first direction;

moving the second area completely onto the display; and

displaying the second representative image for the second sequence of images in the second area.

14. The method of claim 13, including:

in response to detecting termination of the gesture while moving the first area and the second area;

in accordance with a determination that the gesture does not meet the next-sequence-navigation criteria;

moving the second area completely off the display in a second direction, opposite the first direction;

moving the first area completely onto the display; and

displaying the first representative image for the first sequence of images in the first area.

15. The method of claim 1, wherein the first sequence of images is a message in a message conversation displayed in a scrollable region of a messaging application, and the first sequence of images is displayed as the scrollable region of the messaging application is scrolled.

16. An electronic device, comprising:

a display;

a touch-sensitive surface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

storing a plurality of sequences of images, wherein a respective sequence of images includes;

a respective representative image taken by a camera, and

one or more images acquired by the camera before acquiring the respective representative image;

displaying a first representative image for a first sequence of images in a movable first area on the display;

detecting a gesture on the touch-sensitive surface, the gesture including movement by a contact that corresponds to movement in a first direction on the display;

in response to detecting the gesture on the touch-sensitive surface;

moving the first area in the first direction on the display;

moving a movable second area in the first direction on the display; and

,

in accordance with a determination that sequence-display criteria are met, while moving the second area in the first direction, displaying, in chronological order in the second area, at least some of the one or more images for a second sequence of images acquired by the camera before acquiring a second representative image for the second sequence of images.

17. The electronic device of claim 16, including instructions for:

in response to detecting the gesture on the touch-sensitive surface;

in accordance with a determination that the sequence-display criteria are not met, while moving the second area in the first direction, displaying the second representative image for the second sequence of images in the movable second area on the display.

18. The electronic device of claim 16, wherein the sequence-display criteria include a criterion that the contact lifts off prior to displaying, in chronological order in the second area, at least some of the one or more images for the second sequence of images acquired by the camera before acquiring the second representative image.

19. The electronic device of claim 16, wherein moving the movable second area in the first direction on the display includes displaying a respective prior image that was acquired prior to acquiring the second representative image in the second region.

20. The electronic device of claim 16, wherein the sequence-display criteria include detecting liftoff of the contact;

and the electronic device includes instructions for;

in response to detecting liftoff of the contact, continuing to move the moveable second area in the first direction and continuing to move the moveable first area in the first direction, wherein the images from the second sequence of images are displayed at a rate such that the second representative image is displayed in the moveable second area when the moveable second area stops moving in the first direction.

21. The electronic device of claim 16, including instructions for, while moving the moveable first region, displaying a simulated parallax effect for an image within the moveable first region such that the image within the moveable first region shifts relative to a frame of the moveable first region.

22. The electronic device of claim 16, including instructions for, while moving the moveable second region while the contact is detected on the touch-sensitive surface, displaying a simulated parallax effect for an image within the moveable second region such that the image within the moveable second region shifts relative to a frame of the moveable second region.

23. The electronic device of claim 16, wherein a respective sequence of images includes one or more images acquired by the camera after acquiring the respective representative image.

24. The electronic device of claim 16, wherein moving the first area in the first direction includes moving at least part of the first area off of the display in the first direction.

25. The electronic device of claim 16, wherein moving the second area in the first direction includes moving at least part of the second area onto the display in the first direction.

26. The electronic device of claim 16, including instructions for, after moving the second area in the first direction, displaying the second representative image for the second sequence of images in the second area.

27. The electronic device of claim 26, including instructions for:

while displaying the second representative image for the second sequence of images in the second area, detecting a change in intensity of an input corresponding to the second representative image; and

in response to detecting the change in intensity of the input, advancing through the second sequence of images in the second area without moving the second area on the display.

28. The electronic device of claim 16, including instructions for:

detecting termination of the gesture while moving the first area and the second area; and

in response to detecting termination of the gesture while moving the first area and the second area;

in accordance with a determination that the gesture meets next-sequence-navigation criteria;

moving the first area completely off the display in the first direction;

moving the second area completely onto the display; and

displaying the second representative image for the second sequence of images in the second area.

29. The electronic device of claim 28, including instructions for:

in response to detecting termination of the gesture while moving the first area and the second area;

in accordance with a determination that the gesture does not meet the next- sequence-navigation criteria;

moving the second area completely off the display in a second direction, opposite the first direction;

moving the first area completely onto the display; and

displaying the first representative image for the first sequence of images in the first area.

30. The electronic device of claim 16, wherein the first sequence of images is a message in a message conversation displayed in a scrollable region of a messaging application, and the first sequence of images is displayed as the scrollable region of the messaging application is scrolled.

31. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to:

store a plurality of sequences of images, wherein a respective sequence of images includes;

a respective representative image taken by a camera, and one or more images acquired by the camera before acquiring the respective representative image;

display a first representative image for a first sequence of images in a movable first area on the display;

detect a gesture on the touch-sensitive surface, the gesture including movement by a contact that corresponds to movement in a first direction on the display;

in response to detecting the gesture on the touch-sensitive surface;

move the first area in the first direction on the display;

move a movable second area in the first direction on the display; and

, in accordance with a determination that sequence-display criteria are met, while moving the second area in the first direction, display, in chronological order in the second area, at least some of the one or more images for a second sequence of images acquired by the camera before acquiring a second representative image for the second sequence of images.

32. non-transitory the computer readable storage medium of claim 31, including instructions, which when executed by the electronic device, cause the electronic device to:

in response to detecting the gesture on the touch-sensitive surface;

in accordance with a determination that the sequence-display criteria are not met, while moving the second area in the first direction, display the second representative image for the second sequence of images in the movable second area on the display.

33. non-transitory the computer readable storage medium of claim 31, wherein the sequence-display criteria include a criterion that the contact lifts off prior to displaying, in chronological order in the second area, at least some of the one or more images for the second sequence of images acquired by the camera before acquiring the second representative image.

34. the non-transitory computer readable storage medium of claim 31, wherein moving the movable second area in the first direction on the display includes displaying a respective prior image that was acquired prior to acquiring the second representative image in the second region.

35. the non-transitory computer readable storage medium of claim 31, wherein the sequence-display criteria include detecting liftoff of the contact;

and the one or more programs comprise instructions, which when executed by the electronic device cause the electronic device to;

in response to detecting liftoff of the contact, continue to move the moveable second area in the first direction and continue to move the moveable first area in the first direction, wherein the images from the second sequence of images are displayed at a rate such that the second representative image is displayed in the moveable second area when the moveable second area stops moving in the first direction.

36. the non-transitory computer readable storage medium of claim 31, including instructions, which when executed by the electronic device, cause the electronic device to, while moving the moveable first region, display a simulated parallax effect for an image within the moveable first region such that the image within the moveable first region shifts relative to a frame of the moveable first region.

37. the non-transitory computer readable storage medium of claim 31, including instructions, which when executed by the electronic device, cause the electronic device to, while moving the moveable second region while the contact is detected on the touch-sensitive surface, display a simulated parallax effect for an image within the moveable second region such that the image within the moveable second region shifts relative to a frame of the moveable second region.

38. the non-transitory computer readable storage medium of claim 31, wherein a respective sequence of images includes one or more images acquired by the camera after acquiring the respective representative image.

39. the non-transitory computer readable storage medium of claim 31, wherein moving the first area in the first direction includes moving at least part of the first area off of the display in the first direction.

40. the non-transitory computer readable storage medium of claim 31, wherein moving the second area in the first direction includes moving at least part of the second area onto the display in the first direction.

41. the non-transitory computer readable storage medium of claim 31, including instructions, which when executed by the electronic device, cause the electronic device to, after moving the second area in the first direction, display the second representative image for the second sequence of images in the second area.

42. the non-transitory computer readable storage medium of claim 41, including instructions, which when executed by the electronic device, cause the electronic device to:

while displaying the second representative image for the second sequence of images in the second area, detect a change in intensity of an input corresponding to the second representative image; and

in response to detecting the change in intensity of the input, advance through the second sequence of images in the second area without moving the second area on the display.

43. the non-transitory computer readable storage medium of claim 31, including instructions, which when executed by the electronic device, cause the electronic device to:

detect termination of the gesture while moving the first area and the second area; and

in response to detecting termination of the gesture while moving the first area and the second area;

in accordance with a determination that the gesture meets next-sequence-navigation criteria;

move the first area completely off the display in the first direction;

move the second area completely onto the display; and

display the second representative image for the second sequence of images in the second area.

44. the non-transitory computer readable storage medium of claim 43, including instructions, which when executed by the electronic device, cause the electronic device to:

in response to detecting termination of the gesture while moving the first area and the second area;

in accordance with a determination that the gesture does not meet the next-sequence-navigation criteria;

move the second area completely off the display in a second direction, opposite the first direction;

move the first area completely onto the display; and

display the first representative image for the first sequence of images in the first area.

45. the non-transitory computer readable storage medium of claim 31, wherein the first sequence of images is a message in a message conversation displayed in a scrollable region of a messaging application, and the first sequence of images is displayed as the scrollable region of the messaging application is scrolled.