Systems and methods for remote camera control

• US 8,675,084 B2
• Filed: 09/04/2009
• Issued: 03/18/2014
• Est. Priority Date: 09/04/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bolton, Lawrence G., Louboutin, Sylvain R. Y., Rathi, Shailesh, Rempel, David J., Langenfeld, Peter T.
• Primary Examiner(s): Henn, Timothy J
• Application Number:
  US12/554,228
• Publication Number:
  US 20110058052A1
• Time in Patent Office: 1,656 Days
• Field of Search: 34821199-2114, 348/211.6
• US Class Current: 348/211.4
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 1/00347 with another still picture apparatus, e.g. hybrid still picture apparatus circuits or arrangements for control or supervision between image input and image output device H04N1/32
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/0013 Arrangements for the control of the connected apparatus by the still picture apparatus arrangements for the control of a still picture apparatus by the connected apparatus H04N2201/0074; control of image communication with the connected apparatus H04N2201/0015
• CPC Class Codes: H04N 2201/0055 By radio
• CPC Class Codes: H04N 2201/0074 Arrangements for the control of a still picture apparatus by the connected apparatus arrangements for the control of the connected apparatus by the still picture apparatus H04N2201/0013; control of image communication with the connected apparatus H04N2201/0015
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/0087 Image storage device
• CPC Class Codes: H04N 2201/0089 Image display device
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

A camera capable of capturing still images and video and included in a portable media device can be controlled remotely using an accessory. The accessory can register with the PMD to automatically receive notifications whenever there is a change in the camera state. The camera states can include mode, operation status, and configuration settings. The accessory can send instructions to a camera application that interfaces with the camera to control the camera. The accessory can remotely activate the camera, change camera mode, and send instructions to operate the camera. The accessory and the PMD can concurrently control the camera. The PMD can send the captured still images and recorded video to the accessory for preview and receive instructions from the accessory on disposition of the still images and the video.

Claims

1. A method for controlling a camera included in a portable media device communicably coupled with an accessory, the method comprising, by the accessory:

registering with the portable media device to obtain notifications about camera state;

receiving a first camera status notification from the portable media device, wherein the first camera status notification indicates that the camera is ready to take a still image;

in response to receiving the first camera notification, automatically placing the accessory in a first state, the first state indicative that the camera is ready to capture the still image;

receiving a second camera status notification from the portable media device, the second camera status notification indicating that the camera has captured the still image;

in response to receiving the second camera status notification, automatically placing the accessory in a second state, the second state allowing the still image to be displayed on a display of the accessory;

receiving a third camera status notification from the portable media device, wherein the third camera status notification indicates that the camera is ready to capture a video;

in response to receiving the third camera notification, automatically placing the accessory in a third state, the third state indicative that the camera is ready to capture the video;

receiving a fourth camera status notification from the portable media device, wherein the fourth camera status notification indicates that the camera has captured the video; and

in response to receiving the fourth camera notification, automatically placing the accessory in a fourth state, the fourth state allowing the video to be displayed on the display of the accessory.

2. The method of claim 1 wherein the first, the second, the third, and the fourth camera status notifications are received asynchronously.

3. The method of claim 1 further comprising:

receiving, from the portable media device, information about the still image or the video captured by the camera.

4. The method of claim 1 further comprising:

sending a command to the portable media device, the command instructing the portable media device to change camera mode.

5. The method of claim 1 further comprising:

sending a command to the portable media device, the command instructing the portable media device to capture a plurality of images separated by a predetermined time interval.

6. The method of claim 5 wherein the predetermined time interval is specified in the command.

7. The method of claim 1 further comprising sending an image capture command periodically to the portable media device.

8. A non-transitory computer-readable storage medium storing a plurality of instructions, that when executed by a controller in an accessory, cause the controller to perform a method for controlling a camera included in a portable media device, the method comprising:

registering with the portable media device to obtain notifications about camera state;

receiving a first camera status notification from the portable media device, wherein the first camera status notification indicates that the camera is ready to take a still image;

in response to receiving the first camera notification, automatically placing the accessory in a first state, the first state indicative that the camera is ready to capture the still image;

receiving a second camera status notification from the portable media device, the second camera status notification indicating that the camera has captured the still image;

in response to receiving the second camera status notification, automatically placing the accessory in a second state, the second state allowing the still image to be displayed on a display of the accessory;

receiving a third camera status notification from the portable media device, wherein the third camera status notification indicates that the camera is ready to capture a video;

in response to receiving the third camera notification, automatically placing the accessory in a third state, the third state indicative that the camera is ready to capture the video;

receiving a fourth camera status notification from the portable media device, wherein the fourth camera status notification indicates that the camera has captured the video; and

in response to receiving the fourth camera notification, automatically placing the accessory in a fourth state, the fourth state allowing the video to be displayed on the display of the accessory.

9. The computer-readable storage medium of claim 8 wherein the method further includes receiving an image captured by the camera.

10. The computer-readable storage medium of claim 8 wherein the method further includes:

receiving a fifth camera status notification, wherein the fifth camera status notification includes information about whether the camera is active or inactive.

11. An accessory comprising:

a storage medium configured to store information received from a portable media device;

a device interface; and

a controller coupled to the storage medium and the device interface, wherein the device interface is configured to communicate with the portable media device having a camera using a set of commands, the set of commands including;

a first command sendable by the accessory, the first command requesting registration to receive notification related to the camera;

a second command receivable by the accessory, the second command including a camera status notification, wherein the camera status notification includes information indicative of an operational status of the camera;

a third command sendable by the accessory, the third command instructing the camera to either capture a still image or toggle video between a recording state and a recording stopped state; and

a fourth command sendable by the accessory, the fourth command instructing the portable media device to activate the camera if the camera status notification indicates that the camera is inactive;

wherein the camera is operable by the accessory and the portable media device concurrently.

12. The accessory of claim 11 wherein the operational status includes information about whether the camera is active or inactive.

13. The accessory of claim 11 wherein the set of commands further includes:

a fifth command receivable by the accessory, the fifth command including information about current camera mode; and

a sixth command sendable by the accessory, the sixth command including instructions to change the current camera mode to a different camera mode.

14. The accessory of claim 11 wherein the set of commands further includes:

fifth command receivable by the accessory, the fifth command including the image captured by the camera.

15. The accessory of claim 14 wherein the image includes a still photograph or a video recording.

16. The accessory of claim 11 wherein the set of commands further includes:

a fifth command sendable by the accessory, the fifth command instructing the portable media device to periodically capture images.

17. A portable media device for use with an accessory, the portable media device comprising:

a camera;

a storage device;

an accessory interface configured to communicate with the accessory using a set of commands;

wherein the set of commands includes;

a first command receivable by the portable media device from the accessory, the first command requesting registration to receive camera status change notification;

a second command sendable by the portable media device to the accessory, the second command providing camera status information;

a third command sendable by the portable media device to the accessory, the third command including camera mode information; and

a fourth command receivable by the portable media device from the accessory, the fourth command including instructions for the camera to either capture a still image or toggle video between a recording state or a recording stopped state;

a fifth command sendable by the accessory, the fifth command instructing the portable media device to activate the camera if the camera status information indicates that the camera is inactive;

a user interface configured to communicate camera control signals to the camera; and

a processor coupled to the camera, the storage device, and the accessory interface, the processor configured to execute a camera application, wherein the camera application is configured to process the control signals received from the user interface and commands received from the accessory concurrently.

18. The portable media device of claim 17 wherein the set of commands further includes a sixth command sendable by the portable media device, the sixth command including the image captured by the camera.

19. The portable media device of claim 17 wherein the set of commands further includes a sixth command receivable by the portable media device in response to the second command, the sixth command instructing the portable media device to activate the camera application.

20. The portable media device of claim 17 further comprising an illuminating device, wherein the set of commands further includes:

a sixth command receivable by the portable media device from the accessory, the sixth command instructing the portable media device to turn the illuminating device on or off.

21. A non-transitory computer-readable medium containing program instructions that, when executed by a processor within a portable media device having a camera, cause the processor to execute a method of controlling the camera, the method comprising:

receiving a request from an accessory for registration to receive camera status change notification;

providing camera status information to the accessory, the camera status information including information about whether the camera is active or inactive;

receiving a command from the accessory to activate the camera if the camera status information indicates that the camera is inactive;

providing camera mode information to the accessory, the camera mode information including information about whether the camera is in a still photo mode or a video mode;

receiving instructions from the accessory to operate the camera;

operating the camera based on the instructions;

receiving signals from a user interface local to the portable media device; and

operating the camera based on the signals concurrently with operating the camera based on the instructions received from the accessory.

22. The non-transitory computer-readable medium of claim 21 wherein the method further comprises:

sending an image captured by the camera to the accessory; and

receiving instructions, from the accessory, about disposition of the image.

23. The non-transitory computer-readable medium of claim 21 wherein receiving instructions to operate the camera includes receiving instructions to change the camera mode from a first mode to a second mode.

24. The non-transitory computer-readable medium of claim 21 wherein receiving instructions to operate the camera includes receiving instructions to capture an image using the camera.