Remote camera user interface

• US 9,973,674 B2
• Filed: 09/16/2016
• Issued: 05/15/2018
• Est. Priority Date: 09/02/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Dye, Alan C., Chaudhri, Imran, Foss, Christopher Patrick, Wilson, Christopher, Lemay, Stephen O., Butcher, Gary Ian, Yang, Lawrence Y., Karunamuni, Chanaka G., Maric, Natalia, Manzari, Johnnie
• Primary Examiner(s): PRABHAKHER, PRITHAM DAVID
• Application Number:
  US15/268,115
• Publication Number:
  US 20170006210A1
• Time in Patent Office: 606 Days
• Field of Search: 3482112
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

At an electronic device with a touch-sensitive display, a remote camera control user interface may be displayed. In some examples, a user may provide input through a gesture at a location corresponding to the touch-sensitive display and/or through a rotation of a rotatable input mechanism to control a camera of an external device. Camera control may include control of the external device'"'"'s camera features, including image capture, zoom settings, focus settings, flash settings, and timer settings, for example, and may also include access to the external device'"'"'s library of previously captured images.

Claims

1. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a touch-sensitive display and a rotatable input mechanism that is separate from the touch-sensitive display, cause the device to:

display a camera affordance on the touch-sensitive display;

detect a gesture at a location corresponding to the camera affordance;

determine whether the electronic device is wirelessly connected to an external device responsive to remote camera control;

in accordance with a determination that the electronic device is wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

display a remote camera user-interface on the touch-sensitive display;

receive data representing an image feed from a camera of the external device; and

display the image feed in the remote camera user-interface;

detect movement of the rotatable input mechanism that is separate from the touch-sensitive display; and

in response to the detection of movement of the rotatable input mechanism;

resize the display of the image feed in the remote camera user-interface.

2. The non-transitory computer readable storage medium of claim 1, wherein the one or more programs comprise instructions that cause the device to:

further in response to the detection of movement of the rotatable input mechanism;

transmit a zoom setting selection to the external device.

3. The non-transitory computer readable storage medium of claim 2, wherein the remote camera user-interface further comprises a shutter affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmit an image capture request to the external device; and

transmit the zoom setting selection with the image capture request.

4. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface further comprises a toggle affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the toggle affordance; and

in response to the detection of a gesture at a location corresponding to the toggle affordance;

change an action associated with detecting movement of the rotatable input mechanism, wherein the action comprises one of resizing the display of the image feed in the remote camera user-interface and transmitting a focus setting selection to the external device.

5. The non-transitory computer readable storage medium of claim 1, wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the display of the image feed; and

in response to the detection of a gesture at a location corresponding to the display of the image feed;

transmit a focus setting selection to the external device.

6. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface further comprises a shutter affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmit an image capture request to the external device.

7. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface further comprises a shutter affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmit an image capture request to the external device, the image capture request associated with an image capture time; and

end the display of the image feed before the image capture time.

8. The non-transitory computer readable storage medium of claim 7, wherein the image capture request comprises a requested image capture time.

9. The non-transitory computer readable storage medium of claim 7, wherein ending the display of the image feed occurs prior to transmitting the image capture request to the external device.

10. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface comprises a flash affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the flash affordance; and

in response to the detection of a gesture at a location corresponding to the flash affordance;

transmit a camera flash selection to the external device, wherein the camera flash selection comprises an auto/on/off setting of a camera flash of the external device.

11. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface further comprises a timer affordance and a shutter affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the timer affordance;

detect a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

delay transmission of the image capture request.

12. The non-transitory computer readable storage medium of claim 11, wherein delaying transmission of the image capture request comprises delaying the transmission by one selected from a two-second delay and a ten-second delay.

13. The non-transitory computer readable storage medium of claim 12, wherein the one or more programs comprise instructions that cause the device to:

in response to the detection of a gesture at a location corresponding to the shutter affordance;

display a count-down to the image capture time.

14. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface further comprises a timer affordance and a shutter affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the timer affordance;

detect a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

transmit a requested image capture time with an image capture request, wherein the requested image capture time accounts for a timer setting associated with the timer affordance.

15. The non-transitory computer readable storage medium of claim 14, wherein the timer setting is one selected from a two-second timer setting and a ten-second timer setting.

16. The non-transitory computer readable storage medium of claim 1, wherein the remote camera user-interface further comprises an image preview affordance, and wherein the one or more programs comprise instructions that cause the device to:

detect a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

display one or more images of a photo album of the external device.

17. The non-transitory computer readable storage medium of claim 16, wherein the image preview affordance comprises a thumbnail of an image of the photo album of the external device.

18. The non-transitory computer readable storage medium of claim 1, wherein the one or more programs comprise instructions that cause the device to:

in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

display a notification that the external device is not responsive to remote camera control.

19. The non-transitory computer readable storage medium of claim 1, wherein the one or more programs comprise instructions that cause the device to:

further in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

display an image preview affordance; and

detect a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

display one or more images of a photo album stored on the electronic device.

20. The non-transitory computer readable storage medium of claim 1, wherein detecting a gesture at a location corresponding to the camera affordance comprises detecting a contact on the camera affordance and detecting liftoff of the contact.

21. The non-transitory computer readable storage medium of claim 1, wherein the rotatable input mechanism is a rotatable input device or a depressible and rotatable input device.

22. The non-transitory computer readable storage medium of claim 1, wherein:

the movement of the rotatable input mechanism is detected while displaying the remote camera user-interface on the touch-sensitive display, and

the movement of the rotatable input mechanism is relative to the touch-sensitive display.

23. The non-transitory computer readable storage medium of claim 1, wherein an amount of resizing of the display of the image feed in the remote camera user-interface on the touch-sensitive display is determined based on an amount of movement of the rotatable input mechanism relative to the touch-sensitive display.

24. A method, comprising:

at an electronic device with a touch-sensitive display and a rotatable input mechanism that is separate from the touch-sensitive display;

displaying a camera affordance on the touch-sensitive display;

detecting a gesture at a location corresponding to the camera affordance;

determining whether the electronic device is wirelessly connected to an external device responsive to remote camera control;

in accordance with a determination that the electronic device is wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a remote camera user-interface on the touch-sensitive display;

receiving data representing an image feed from a camera of the external device; and

displaying the image feed in the remote camera user-interface;

detecting movement of the rotatable input mechanism that is separate from the touch-sensitive display; and

in response to the detection of movement of the rotatable input mechanism;

resizing the display of the image feed in the remote camera user-interface.

25. The method of claim 24, further comprising:

further in response to the detection of movement of the rotatable input mechanism;

transmitting a zoom setting selection to the external device.

26. The method of claim 25, wherein the remote camera user-interface further comprises a shutter affordance, and further comprising:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device; and

transmitting the zoom setting selection with the image capture request.

27. The method of claim 24, wherein the remote camera user-interface further comprises a toggle affordance, and further comprising:

detecting a gesture at a location corresponding to the toggle affordance; and

in response to the detection of a gesture at a location corresponding to the toggle affordance;

changing an action associated with detecting movement of the rotatable input mechanism, wherein the action comprises one of resizing the display of the image feed in the remote camera user-interface and transmitting a focus setting selection to the external device.

28. The method of claim 24, further comprising:

detecting a gesture at a location corresponding to the display of the image feed; and

in response to the detection of a gesture at a location corresponding to the display of the image feed;

transmitting a focus setting selection to the external device.

29. The method of claim 24, wherein the remote camera user-interface further comprises a shutter affordance, and further comprising:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device.

30. The method of claim 24, wherein the remote camera user-interface further comprises a shutter affordance, and further comprising:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

ending the display of the image feed before the image capture time.

31. The method of claim 30, wherein the image capture request comprises a requested image capture time.

32. The method of claim 30, wherein ending the display of the image feed occurs prior to transmitting the image capture request to the external device.

33. The method of claim 24, wherein the remote camera user-interface comprises a flash affordance, and further comprising:

detecting a gesture at a location corresponding to the flash affordance; and

in response to the detection of a gesture at a location corresponding to the flash affordance;

transmitting a camera flash selection to the external device, wherein the camera flash selection comprises an auto/on/off setting of a camera flash of the external device.

34. The method of claim 24, wherein the remote camera user-interface further comprises a timer affordance and a shutter affordance, and further comprising:

detecting a gesture at a location corresponding to the timer affordance;

detect a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

delaying transmission of the image capture request.

35. The method of claim 34, wherein delaying transmission of the image capture request comprises delaying the transmission by one selected from a two-second delay and a ten-second delay.

36. The method of claim 35, further comprising:

in response to the detection of a gesture at a location corresponding to the shutter affordance;

displaying a count-down to the image capture time.

37. The method of claim 24, wherein the remote camera user-interface further comprises a timer affordance and a shutter affordance, and further comprising:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting a requested image capture time with an image capture request, wherein the requested image capture time accounts for a timer setting associated with the timer affordance.

38. The method of claim 37, wherein the timer setting is one selected from a two-second timer setting and a ten-second timer setting.

39. The method of claim 24, wherein the remote camera user-interface further comprises an image preview affordance, and further comprising:

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album of the external device.

40. The method of claim 39, wherein the image preview affordance comprises a thumbnail of an image of the photo album of the external device.

41. The method of claim 24, further comprising:

in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a notification that the external device is not responsive to remote camera control.

42. The method of claim 24, further comprising:

further in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying an image preview affordance; and

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album stored on the electronic device.

43. The method of claim 24, wherein detecting a gesture at a location corresponding to the camera affordance comprises detecting a contact on the camera affordance and detecting liftoff of the contact.

44. The method of claim 24, wherein the rotatable input mechanism is a rotatable input device or a depressible and rotatable input device.

45. The method of claim 24, wherein:

the movement of the rotatable input mechanism is detected while displaying the remote camera user-interface on the touch-sensitive display, and

the movement of the rotatable input mechanism is relative to the touch-sensitive display.

46. The method of claim 24, wherein an amount of resizing of the display of the image feed in the remote camera user-interface on the touch-sensitive display is determined based on an amount of movement of the rotatable input mechanism relative to the touch-sensitive display.

47. An electronic device, comprising:

a touch-sensitive display;

a rotatable input mechanism that is separate from the touch-sensitive display;

one or more processors;

a memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a camera affordance on the touch-sensitive display;

detecting a gesture at a location corresponding to the camera affordance;

determining whether the electronic device is wirelessly connected to an external device responsive to remote camera control;

in accordance with a determination that the electronic device is wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a remote camera user-interface on the touch-sensitive display;

receiving data representing an image feed from a camera of the external device; and

displaying the image feed in the remote camera user-interface;

detecting movement of the rotatable input mechanism that is separate from the touch-sensitive display; and

in response to the detection of movement of the rotatable input mechanism;

resizing the display of the image feed in the remote camera user-interface.

48. The electronic device of claim 47, the one or more programs further including instructions for:

further in response to the detection of movement of the rotatable input mechanism;

transmitting a zoom setting selection to the external device.

49. The electronic device of claim 48, wherein the remote camera user-interface further comprises a shutter affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device; and

transmitting the zoom setting selection with the image capture request.

50. The electronic device of claim 47, wherein the remote camera user-interface further comprises a toggle affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the toggle affordance; and

in response to the detection of a gesture at a location corresponding to the toggle affordance;

changing an action associated with detecting movement of the rotatable input mechanism, wherein the action comprises one of resizing the display of the image feed in the remote camera user-interface and transmitting a focus setting selection to the external device.

51. The electronic device of claim 47, the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the display of the image feed; and

in response to the detection of a gesture at a location corresponding to the display of the image feed;

transmitting a focus setting selection to the external device.

52. The electronic device of claim 47, wherein the remote camera user-interface further comprises a shutter affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device.

53. The electronic device of claim 47, wherein the remote camera user-interface further comprises a shutter affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting an image capture request to the external device, the image capture request associated with an image capture time; and

ending the display of the image feed before the image capture time.

54. The electronic device of claim 53, wherein the image capture request comprises a requested image capture time.

55. The electronic device of claim 53, wherein ending the display of the image feed occurs prior to transmitting the image capture request to the external device.

56. The electronic device of claim 47, wherein the remote camera user-interface comprises a flash affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the flash affordance; and

in response to the detection of a gesture at a location corresponding to the flash affordance;

transmitting a camera flash selection to the external device, wherein the camera flash selection comprises an auto/on/off setting of a camera flash of the external device.

57. The electronic device of claim 47, wherein the remote camera user-interface further comprises a timer affordance and a shutter affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the timer affordance;

detect a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

delaying transmission of the image capture request.

58. The electronic device of claim 57, wherein delaying transmission of the image capture request comprises delaying the transmission by one selected from a two-second delay and a ten-second delay.

59. The electronic device of claim 57, the one or more programs further including instructions for:

in response to the detection of a gesture at a location corresponding to the shutter affordance;

displaying a count-down to the image capture time.

60. The electronic device of claim 47, wherein the remote camera user-interface further comprises a timer affordance and a shutter affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the timer affordance;

detecting a gesture at a location corresponding to the shutter affordance; and

in response to the detection of a gesture at a location corresponding to the timer affordance and to the detection of a gesture at a location corresponding to the shutter affordance;

transmitting a requested image capture time with an image capture request, wherein the requested image capture time accounts for a timer setting associated with the timer affordance.

61. The electronic device of claim 60, wherein the timer setting is one selected from a two-second timer setting and a ten-second timer setting.

62. The electronic device of claim 47, wherein the remote camera user-interface further comprises an image preview affordance, and the one or more programs further including instructions for:

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album of the external device.

63. The electronic device of claim 62, wherein the image preview affordance comprises a thumbnail of an image of the photo album of the external device.

64. The electronic device of claim 47, the one or more programs further including instructions for:

in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying a notification that the external device is not responsive to remote camera control.

65. The electronic device of claim 47, the one or more programs further including instructions for:

further in accordance with a determination that the electronic device is not wirelessly connected to the external device and in response to the detection of a gesture at a location corresponding to the camera affordance;

displaying an image preview affordance; and

detecting a gesture at a location corresponding to the image preview affordance; and

in response to the detection of a gesture at a location corresponding to the image preview affordance;

displaying one or more images of a photo album stored on the electronic device.

66. The electronic device of claim 47, wherein detecting a gesture at a location corresponding to the camera affordance comprises detecting a contact on the camera affordance and detecting liftoff of the contact.

67. The electronic device of claim 47, wherein the rotatable input mechanism is a rotatable input device or a depressible and rotatable input device.

68. The electronic device of claim 47, wherein:

the movement of the rotatable input mechanism is detected while displaying the remote camera user-interface on the touch-sensitive display, and

the movement of the rotatable input mechanism is relative to the touch-sensitive display.

69. The electronic device of claim 47, wherein an amount of resizing of the display of the image feed in the remote camera user-interface on the touch-sensitive display is determined based on an amount of movement of the rotatable input mechanism relative to the touch-sensitive display.