Remote camera user interface

• US 10,200,587 B2
• Filed: 05/09/2018
• Issued: 02/05/2019
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Dye, Alan C., Chaudhri, Imran, Foss, Christopher Patrick, Wilson, Christopher, Lemay, Stephen O., Butcher, Gary Ian, Yang, Lawrence Y., Karunamuni, Chanaka G., Maric, Natalia, Manzari, Johnnie
• Primary Examiner(s): Prabhakher, Pritham D
• Application Number:
  US15/975,581
• Publication Number:
  US 20180262677A1
• Time in Patent Office: 272 Days
• Field of Search: 3482112
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

At an electronic device with a touch-sensitive display, a remote camera control user interface may be displayed. In some examples, a user may provide input through a gesture at a location corresponding to the touch-sensitive display and/or through a rotation of a rotatable input mechanism to control a camera of an external device. Camera control may include control of the external device'"'"'s camera features, including image capture, zoom settings, focus settings, flash settings, and timer settings, for example, and may also include access to the external device'"'"'s library of previously captured images.

Claims

1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a touch-sensitive display and a rotatable input mechanism, the one or more programs including instructions for:

displaying a camera affordance on the touch-sensitive display;

detecting a gesture at a location corresponding to the camera affordance;

determining whether the electronic device is wirelessly connected to an external device responsive to remote camera control;

in accordance with a determination that the electronic device is wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a remote camera user-interface on the touch-sensitive display;

receiving data representing an image feed from a camera of the external device; and

displaying the image feed in the remote camera user-interface;

detecting movement of the rotatable input mechanism; and

in response to the detection of movement of the rotatable input mechanism;

transmitting a focus setting selection to the external device.

2. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

transmitting the focus setting selection with the image capture request.

3. The non-transitory computer readable storage medium of claim 2, wherein the remote camera user-interface comprises a toggle affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the toggle affordance; and

in response to the detection of a gesture at a location corresponding to the toggle affordance;

changing an action associated with detecting movement of the rotatable input mechanism, wherein the action comprises one of resizing the display of the image feed in the remote camera user-interface and transmitting a focus setting selection to the external device.

4. The non-transitory computer readable storage medium of claim 1, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the display of the image feed; and

in response to the detection of a gesture at a location corresponding to the display of the image feed;

transmitting a focus setting selection to the external device.

5. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device.

6. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

ending the display of the image feed before the image capture time.

7. The non-transitory computer readable storage medium of claim 6, wherein the image capture request comprises a requested image capture time.

8. The non-transitory computer readable storage medium of claim 7, the one or more programs further including instructions for:

further in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying an image preview affordance; and

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album stored on the electronic device.

9. The non-transitory computer readable storage medium of claim 6, wherein ending the display of the image feed occurs prior to transmitting the image capture request to the external device.

10. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises a timer affordance and a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

delaying transmission of the image capture request.

11. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises a flash affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the flash affordance; and

in response to the detection of a gesture at a location corresponding to the flash affordance;

transmitting a camera flash selection to the external device, wherein the camera flash selection comprises an auto/on/off setting of a camera flash of the external device.

12. The non-transitory computer readable storage medium of claim 10, the one or more programs further including instructions for:

in response to the detection of a gesture at a location corresponding to the shutter affordance;

displaying a count-down to the image capture time.

13. The non-transitory computer readable storage medium of claim 12, wherein delaying transmission of the image capture request comprises delaying the transmission by one selected from a two-second delay and a ten-second delay.

14. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises a timer affordance and a shutter affordance the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting a requested image capture time with an image capture request, wherein the requested image capture time accounts for a timer setting associated with the timer affordance.

15. The non-transitory computer readable storage medium of claim 14, wherein the timer setting is one selected from a two-second timer setting and a ten-second timer setting.

16. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises an image preview affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album of the external device.

17. The non-transitory computer readable storage medium of claim 16, wherein the image preview affordance comprises a thumbnail of an image of the photo album of the external device.

18. The non-transitory computer readable storage medium of claim 1, the one or more programs further including instructions for:

in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a notification that the external device is not responsive to remote camera control.

19. The non-transitory computer readable storage medium of claim 1, wherein detecting a gesture at a location corresponding to the camera affordance comprises detecting a contact on the camera affordance and detecting liftoff of the contact.

20. An electronic device, comprising:

a touch-sensitive display;

a rotatable input mechanism;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a camera affordance on the touch-sensitive display;

detecting a gesture at a location corresponding to the camera affordance;

determining whether the electronic device is wirelessly connected to an external device responsive to remote camera control;

in accordance with a determination that the electronic device is wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a remote camera user-interface on the touch-sensitive display;

receiving data representing an image feed from a camera of the external device; and

displaying the image feed in the remote camera user-interface;

detecting movement of the rotatable input mechanism; and

in response to the detection of movement of the rotatable input mechanism;

transmitting a focus setting selection to the external device.

21. The electronic device of claim 20, wherein the remote camera user-interface comprises a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

transmitting the focus setting selection with the image capture request.

22. The electronic device of claim 21, wherein the remote camera user-interface comprises a toggle affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the toggle affordance; and

in response to the detection of a gesture at a location corresponding to the toggle affordance;

changing an action associated with detecting movement of the rotatable input mechanism, wherein the action comprises one of resizing the display of the image feed in the remote camera user-interface and transmitting a focus setting selection to the external device.

23. The electronic device of claim 20, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the display of the image feed; and

in response to the detection of a gesture at a location corresponding to the display of the image feed;

transmitting a focus setting selection to the external device.

24. The electronic device of claim 20, wherein the remote camera user-interface comprises a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device.

25. The electronic device of claim 20, wherein the remote camera user-interface comprises a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

ending the display of the image feed before the image capture time.

26. The electronic device of claim 25, wherein the image capture request comprises a requested image capture time.

27. The electronic device of claim 26, the one or more programs further including instructions for:

further in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying an image preview affordance; and

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album stored on the electronic device.

28. The electronic device of claim 25, wherein ending the display of the image feed occurs prior to transmitting the image capture request to the external device.

29. The electronic device of claim 25, the one or more programs further including instructions for:

in response to the detection of a gesture at a location corresponding to the shutter affordance;

displaying a count-down to the image capture time.

30. The electronic device of claim 20, wherein the remote camera user-interface comprises a flash affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the flash affordance; and

in response to the detection of a gesture at a location corresponding to the flash affordance;

transmitting a camera flash selection to the external device, wherein the camera flash selection comprises an auto/on/off setting of a camera flash of the external device.

31. The electronic device of claim 20, wherein the remote camera user-interface comprises a timer affordance and a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

delaying transmission of an image capture request.

32. The electronic device of claim 31, wherein delaying transmission of the image capture request comprises delaying the transmission by one selected from a two-second delay and a ten-second delay.

33. The electronic device of claim 20, wherein the remote camera user-interface comprises a timer affordance and a shutter affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting a requested image capture time with an image capture request, wherein the requested image capture time accounts for a timer setting associated with the timer affordance.

34. The electronic device of claim 33, wherein the timer setting is one selected from a two-second timer setting and a ten-second timer setting.

35. The electronic device of claim 20, wherein the remote camera user-interface comprises an image preview affordance, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album of the external device.

36. The electronic device of claim 35, wherein the image preview affordance comprises a thumbnail of an image of the photo album of the external device.

37. The electronic device of claim 20, the one or more programs further including instructions for:

in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a notification that the external device is not responsive to remote camera control.

38. The electronic device of claim 20, wherein detecting a gesture at a location corresponding to the camera affordance comprises detecting a contact on the camera affordance and detecting liftoff of the contact.

39. A method, comprising:

at an electronic device with a touch-sensitive display and a rotatable input mechanism;

displaying a camera affordance on the touch-sensitive display;

detecting a gesture at a location corresponding to the camera affordance;

determining whether the electronic device is wirelessly connected to an external device responsive to remote camera control;

in accordance with a determination that the electronic device is wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a remote camera user-interface on the touch-sensitive display;

receiving data representing an image feed from a camera of the external device; and

displaying the image feed in the remote camera user-interface;

detecting movement of the rotatable input mechanism; and

in response to the detection of movement of the rotatable input mechanism;

transmitting a focus setting selection to the external device.

40. The method of claim 39, wherein the remote camera user-interface comprises a shutter affordance, the method further comprising:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

transmitting the focus setting selection with the image capture request.

41. The method of claim 40, wherein the remote camera user-interface comprises a toggle affordance, the method further comprising:

detecting a gesture at a location corresponding to the toggle affordance; and

in response to the detection of a gesture at a location corresponding to the toggle affordance;

changing an action associated with detecting movement of the rotatable input mechanism, wherein the action comprises one of resizing the display of the image feed in the remote camera user-interface and transmitting a focus setting selection to the external device.

42. The method of claim 39, further comprising:

detecting a gesture at a location corresponding to the display of the image feed; and

in response to the detection of a gesture at a location corresponding to the display of the image feed;

transmitting a focus setting selection to the external device.

43. The method of claim 39, wherein the remote camera user-interface comprises a shutter affordance, the method further comprising:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device.

44. The method of claim 39, wherein the remote camera user-interface comprises a shutter affordance, the method further comprising:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

ending the display of the image feed before the image capture time.

45. The method of claim 44, wherein the image capture request comprises a requested image capture time.

46. The method of claim 45, further comprising:

further in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying an image preview affordance; and

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album stored on the electronic device.

47. The method of claim 44, wherein ending the display of the image feed occurs prior to transmitting the image capture request to the external device.

48. The method of claim 44, further comprising:

in response to the detection of a gesture at a location corresponding to the shutter affordance;

displaying a count-down to the image capture time.

49. The method of claim 39, wherein the remote camera user-interface comprises a flash affordance, the method further comprising:

detecting a gesture at a location corresponding to the flash affordance; and

in response to the detection of a gesture at a location corresponding to the flash affordance;

transmitting a camera flash selection to the external device, wherein the camera flash selection comprises an auto/on/off setting of a camera flash of the external device.

50. The method of claim 39, wherein the remote camera user-interface comprises a timer affordance and a shutter affordance, the method further comprising:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

delaying transmission of an image capture request.

51. The method of claim 50, wherein delaying transmission of the image capture request comprises delaying the transmission by one selected from a two-second delay and a ten-second delay.

52. The method of claim 39, wherein the remote camera user-interface comprises a timer affordance and a shutter affordance, the method further comprising:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting a requested image capture time with an image capture request, wherein the requested image capture time accounts for a timer setting associated with the timer affordance.

53. The method of claim 52, wherein the timer setting is one selected from a two-second timer setting and a ten-second timer setting.

54. The method of claim 39, wherein the remote camera user-interface comprises an image preview affordance, the method further comprising:

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album of the external device.

55. The method of claim 54, wherein the image preview affordance comprises a thumbnail of an image of the photo album of the external device.

56. The method of claim 39, further comprising:

in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a notification that the external device is not responsive to remote camera control.

57. The method of claim 39, wherein detecting a gesture at a location corresponding to the camera affordance comprises detecting a contact on the camera affordance and detecting liftoff of the contact.