Systems and methods for reducing boot time and power consumption in camera systems

• US 9,692,967 B1
• Filed: 03/23/2015
• Issued: 06/27/2017
• Est. Priority Date: 03/23/2015
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Bamberger, Alex, Brook, Peter, Dahlquist, Nicolas, Hanover, Matthew, Rodriguez, II, Jonathan M, Patton, Russell Douglas
• Primary Examiner(s): Haskins, Twyler
• Assistant Examiner(s): Trehan, Akshay
• Application Number:
  US14/665,964
• Time in Patent Office: 827 Days
• Field of Search: 34823199, 34833313, 348372
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/32 Means for saving power
• CPC Class Codes: G06F 1/3203 Power management, i.e. event-based initiation of a power-saving mode
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 1/3287 by switching off individual functional units in the computer system
• CPC Class Codes: G06F 1/3293 by switching to a less power-consuming processor, e.g. sub-CPU
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/651 for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management
• CPC Class Codes: Y02D 30/50 in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

Systems and methods for camera devices with low boot time are provided. In one example embodiment, a user input is received at an interface of a camera. In response to the user input, a low-power processor boots a image processor. The image processor then captures camera data and writes the camera data to memory before automatically powering down. In certain embodiments, a low-power wireless connection from the camera to a client device is established. Based on this connection, the low-power processor initiates boot-up of a high-speed processor and wireless communication circuitry, which is used to transmit the camera data to the client device.

Claims

1. A method comprising:

receiving, at an interface of a camera device, a user input, the camera device further comprising a low-power processor, a high-speed processor, a camera, a memory, a battery, an image processor, low-power wireless circuitry integrated with the low-power processor as part of low-power circuitry of the camera device, and high-speed wireless circuitry integrated with the high-speed processor as part of high-speed circuitry of the camera device that is different from the low-power wireless circuitry, wherein the low-power wireless circuitry comprises Bluetooth™

low energy circuitry, and wherein the high-speed wireless circuitry comprises wireless circuitry compliant with Institute of Electrical and Electronics Engineers (IEEE) 802.11 standards;

transmitting a user input signal from the interface to the low-power processor of the camera device;

in response to the user input signal, automatically;

booting the image processor;

capturing, using the image processor, first camera data;

writing the first camera data to the memory; and

shutting down the image processor after writing the first camera data to the memory;

establishing, using the low-power circuitry, a low-power wireless connection with a client device, wherein the low-power wireless connection is established after the shutting down of the image processor;

receiving, via the low-power circuitry, a communication from the client device requesting a transfer of the first camera data;

initiating, using the low-power circuitry, a boot of the high-speed processor;

initiating, using the high-speed processor, a power-on of the high-speed wireless circuitry;

establishing a high-speed wireless connection with the client device using the high-speed wireless circuitry;

communicating the first camera data to the client device using the high-speed wireless connection;

automatically powering down the high-speed processor and the high-speed wireless circuitry after completion of communication of the first camera data to the client device; and

receiving, at the interface of the camera device, a second user input, wherein the second user input is received during communication of the first camera data to the client device;

interrupting communication of the first camera data to the client device in response to receipt of the second user input; and

in response to the user second input, automatically;

booting the image processor;

capturing, using the image processor, second camera data;

writing the second camera data to the memory;

shutting down the image processor; and

resuming communication of the first camera data to the client device after the writing of the second camera data to the memory, wherein the second camera data is communicated to the client device with the first camera data.

2. The method of claim 1 wherein booting the image processor comprises:

transitioning the image processor from a video power-off state to a video power-on state; and

loading a set of image processor instructions from electrically erasable programmable read only memory (EEPROM) to a volatile memory of the image processor using direct memory access (DMA).

3. The method of claim 2 wherein the camera device further comprises a plurality of separate integrated circuits (ICs) consisting of a first IC, a second IC, a third IC, a fourth IC, and the EEPROM;

wherein the image processor consists of a first IC, the first IC comprising image processing circuitry, camera data input/output circuitry coupled to the memory, and boot instructions for accessing the EEPROM IC;

wherein the second IC comprises the memory;

wherein the third IC comprises the low-power processor and low-power wireless circuitry; and

wherein the fourth IC comprises the high-speed processor.

4. The method of claim 3 wherein the first camera data is written to the memory when the high-speed processor is in a high-speed processor power-off state.

5. The method of claim 1 wherein the camera device further comprises:

low-power wireless circuitry integrated with the low-power processor as part of low-power circuitry of the camera device; and

high-speed wireless circuitry integrated with the high-speed processor as part of high-speed circuitry of the camera device that is different from the low-power wireless circuitry.

6. The method of claim 1 further comprising:

determining, using the low-power circuitry, a battery state of the battery; and

communicating, using the low-power circuitry, the battery state to the client device.

7. The method of claim 6 further comprising:

receiving, at the interface of the camera device, a third user input;

determining, using the low-power processor, that the battery state is below a power threshold; and

maintaining the image processor in a video power-off state following receipt of the third user input in response to the determination that the battery state is below the power threshold,

wherein the battery state is communicated to the client device after receipt of the third user input.

8. The method of claim 6 further comprising:

receiving, via the low-power circuitry, a second communication from the client device requesting a second transfer;

determining, using the low-power processor, that the battery state is below a power threshold;

maintaining the high-speed circuitry in a high-speed circuitry off state following receipt of the second communication in response to the determination that the battery state is below the power threshold; and

communicating a battery alert message to the client device in response to the second communication from the client device.

9. The method of claim 1 wherein the interface consists of a physical button,

wherein the user input consists of a depression of the physical button followed directly by a release of the physical button;

and

wherein the first camera data comprises a single image photo captured by the camera.

10. The method of claim 9 wherein the second user input consists of a second depression of the physical button for a first time period followed by a second release of the physical button;

and

wherein the second camera data comprises a video image associated with the first time period.

11. A system comprising:

a camera device comprising;

a frame;

a memory coupled to the frame;

an interface integrated with the frame and configured to receive a user input;

low-power circuitry comprising a low-power processor configured to receive a user input signal from the interface in response to the user input;

an image processor coupled to the low-power processor, the image processor configured to, in response to a boot signal from the low-power circuitry initiated by the user request;

transition from a video power-off state to a video power-on state;

load a set of image processor boot instructions from a non-volatile memory to a volatile memory of the image processor using direct memory access (DMA);

capture camera data from a camera coupled to the image processor;

write the camera data to the memory; and

automatically power down following writing of the camera data to the memory;

low-power wireless circuitry integrated with the low-power processor and configured to establish a low-power wireless connection with a client device; and

high-speed wireless circuitry configured to communicate the camera data to the client device in response to instructions from the low-power processor;

wherein the low power processor is further configured to;

establish the low-power wireless connection after the shutting down of the image processor;

receive a communication from the client device requesting a transfer of the first camera data;

initiate a boot of a high-speed processor;

interrupt communication of the first camera data to the client device in response to receipt of a second user input; and

manage booting of the image processor and shutting down of the image processor after second camera data is written to memory, and resumption of communication of the first camera data to the client device after the writing of the second camera data to the memory wherein the high-speed processor is configured to;

initiating a power-on of the high-speed wireless circuitry;

establish a high-speed wireless connection with the client device using the high-speed wireless circuitry;

communicate the first camera data and the second camera data to the client device using the high-speed wireless connection; and

automatically power down the high-speed processor and the high-speed wireless circuitry after completion of communication of the first camera data and the second camera data to the client device.

12. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a camera device, cause the camera device to perform operations for reduced boot time and power consumption, the operations comprising:

receiving, from an interface of a camera device, a user input signal, wherein the camera device further comprises a low-power processor, a high-speed processor, a camera, a memory, a battery, an image processor, low-power wireless circuitry integrated with the low-power processor as part of low-power circuitry of the camera device, and high-speed wireless circuitry integrated with the high-speed processor as part of high-speed circuitry of the camera device that is different from the low-power wireless circuitry, wherein the low-power wireless circuitry comprises Bluetooth™

low energy circuitry, and wherein the high-speed wireless circuitry comprises wireless circuitry compliant with Institute of Electrical and Electronics Engineers (IEEE) 802.11 standards;

transmitting a user input signal from the interface to the low-power processor of the camera device;

in response to the user input signal, automatically;

booting the image processor;

capturing, using the image processor, first camera data;

writing the first camera data to the memory; and

shutting down the image processor after writing the first camera data to the memory;

establishing, using the low-power circuitry, a low-power wireless connection with a client device, wherein the low-power wireless connection is established after the shutting down of the image processor;

receiving, via the low-power circuitry, a communication from the client device requesting a transfer of the first camera data;

initiating, using the low-power circuitry, a boot of the high-speed processor;

initiating, using the high-speed processor, a power-on of the high-speed wireless circuitry;

establishing a high-speed wireless connection with the client device using the high-speed wireless circuitry;

communicating the first camera data to the client device using the high-speed wireless connection;

automatically powering down the high-speed processor and the high-speed wireless circuitry after completion of communication of the first camera data to the client device; and

receiving, at the interface of the camera device, a second user input, wherein the second user input is received during communication of the first camera data to the client device;

interrupting communication of the first camera data to the client device in response to receipt of the second user input; and

in response to the user second input, automatically;

booting the image processor;

capturing, using the image processor, second camera data;

writing the second camera data to the memory;

shutting down the image processor; and

resuming communication of the first camera data to the client device after the writing of the second camera data to the memory, wherein the second camera data is communicated to the client device with the first camera data.

13. The non-transitory computer readable medium of claim 12 wherein booting the image processor comprises:

transitioning the image processor from a video power-off state to a video power-on state; and

loading a set of image processor instructions from electrically erasable programmable read only memory (EEPROM) to a volatile memory of the image processor using direct memory access (DMA).

14. The non-transitory computer readable medium of claim 13 the camera device further comprises a plurality of separate integrated circuits (ICs) consisting of a first IC, a second IC, a third IC, a fourth IC, and the EEPROM;

wherein the image processor consists of a first IC, the first IC comprising image processing circuitry, camera data input/output circuitry coupled to the memory, and boot instructions for accessing the EEPROM IC;

wherein the second IC comprises the memory;

wherein the third IC comprises the low-power processor and low-power wireless circuitry; and

wherein the fourth IC comprises the high-speed processor.

15. The non-transitory computer readable medium of claim 14 wherein the first camera data is written to the memory when the high-speed processor is in a high-speed processor power-off state.

16. The non-transitory computer readable medium of claim 12 wherein the camera device further comprises:

low-power wireless circuitry integrated with the low-power processor as part of low-power circuitry of the camera device; and

high-speed wireless circuitry integrated with the high-speed processor as part of high-speed circuitry of the camera device that is different from the low-power wireless circuitry.

17. The non-transitory computer readable medium of claim 12 wherein the instructions further cause the camera device to perform operations comprising:

determining, using the low-power circuitry, a battery state of the battery; and

communicating, using the low-power circuitry, the battery state to the client device.

18. The non-transitory computer readable medium of claim 17 wherein the instructions further cause the camera device to perform operations comprising:

receiving, at the interface of the camera device, a third user input;

determining, using the low-power processor, that the battery state is below a power threshold; and

maintaining the image processor in a video power-off state following receipt of the third user input in response to the determination that the battery state is below the power threshold,

wherein the battery state is communicated to the client device after receipt of the third user input.

19. The non-transitory computer readable medium of claim 17 wherein the instructions further cause the camera device to perform operations comprising:

receiving, via the low-power circuitry, a second communication from the client device requesting a second transfer;

determining, using the low-power processor, that the battery state is below a power threshold;

maintaining the high-speed circuitry in a high-speed circuitry off state following receipt of the second communication in response to the determination that the battery state is below the power threshold; and

communicating a battery alert message to the client device in response to the second communication from the client device.

20. The non-transitory computer readable medium of claim 16 wherein the interface consists of a physical button;

wherein the user input consists of a depression of the physical button followed directly by a release of the physical button;

wherein the first camera data comprises a single image photo captured by the camera;

wherein the second user input consists of a second depression of the physical button for a first time period followed by a second release of the physical button; and

wherein the second camera data comprises a video image associated with the first time period.