Adaptive low-light view modes

• US 9,832,394 B2
• Filed: 05/21/2014
• Issued: 11/28/2017
• Est. Priority Date: 03/31/2014
• Status: Expired due to Fees

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Slaby, Jiri, Pierce, William S., Willis, Lawrence A.
• Primary Examiner(s): Walker, Jared
• Application Number:
  US14/283,269
• Publication Number:
  US 20150281593A1
• Time in Patent Office: 1,287 Days
• Field of Search: 348164
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 18/25 Fusion techniques
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 5/265 Mixing

Abstract

This document describes techniques and apparatuses for implementing adaptive low-light view modes. These techniques and apparatuse enable a computing device to capture infrared (IR) imagery at a particular location and retrieve, based on the particular location, previously-captured imagery that corresponds with the IR imagery. The IR imagery and previously-captured imagery can then be combined to provide composite imagery, which is presented to a user. By so doing, the user'"'"'s view of the particular location can be enhanced, particularly in low-light conditions.

Claims

1. A method comprising:

determining, by a first electronic device using a global positioning system, an approximate location of a second electronic device associated with the first electronic device;

transmitting, by the first electronic device via a wireless interface, and to a repository of imagery, the approximate location of the second electronic device;

receiving, by the first electronic device via the wireless interface, and from the repository, imagery associated with the approximate location of the second electronic device;

receiving, by the first electronic device and from the second electronic device, infrared imagery that corresponds to the imagery received from the repository;

merging, by the first electronic device, the imagery received from the repository and the infrared imagery received from the second electronic device; and

transmitting, by the first electronic device and to the second electronic device, the merged imagery effective to cause the second electronic device to present the merged imagery.

2. The method of claim 1, wherein merging the imagery received from the repository and the infrared imagery received from the second electronic device comprises colorizing, based on the imagery received from the repository, elements of the infrared imagery received from the second electronic device.

3. The method of claim 1, further comprising:

determining, by the first electronic device using an accelerometer or a magnetometer, an orientation of the second electronic device; and

transmitting, by the first electronic device, an indication of the orientation of the second electronic device to the repository.

4. The method of claim 1, wherein merging the imagery received from the repository and the infrared imagery received from the second electronic device further comprises:

prioritizing a first set of elements in the imagery received from the repository;

prioritizing a second set of elements in infrared imagery received from the second electronic device; and

merging at least some of the first set of elements and at least some of the second set of elements based on the respective priorities of each element.

5. The method of claim 4, wherein the first set of elements include permanent objects, physical structures, or landmarks.

6. The method of claim 4, wherein the second set of elements include non-permanent type objects or objects captured in real-time.

7. The method of claim 1, wherein the second electronic device comprises one of a smart phone, tablet computer, wearable computer, or vehicle-based display.

8. A first electronic device, comprising:

a global positioning system configured to determine a location of the first electronic device;

a wireless interface configured to enable communication of data via a wireless network;

one or more processors; and

at least one non-transitory computer-readable storage medium storing instructions that are executable by the one or more processors to;

determine, using the global positioning system, an approximate location of a second electronic device;

transmit, via the wireless interface and to a repository of imagery, the approximate location of the second electronic device;

receive, via the wireless interface and from the repository, imagery associated with the approximate location of the second electronic device;

receive, from the second electronic device, infrared imagery that corresponds to the imagery received from the repository;

merge the imagery received from the repository and the infrared imagery received from the second electronic device; and

transmit, to the second electronic device, the merged imagery effective to cause the second electronic device to present the merged imagery.

9. The first electronic device of claim 8, wherein the instructions stored on the at least one non-transitory computer-readable storage medium that cause the one or more processors to merge the imagery received from the repository and the infrared imagery received from the second electronic device further cause the one or more processors to colorize, based on the imagery received from the repository, elements of the infrared imagery received from the second electronic device.

10. The first electronic device of claim 8, wherein the instructions stored on the at least one non-transitory computer-readable storage medium further cause the one or more processors to:

determine, using an accelerometer or a magnetometer, an orientation of the second electronic device; and

transmit an indication of the orientation of the second electronic device to the repository.

11. The first electronic device of claim 8, wherein the instructions stored on the at least one non-transitory computer-readable storage medium that cause the one or more processors to merge the imagery received from the repository and the infrared imagery received from the second electronic device further cause the one or more processors to:

prioritize a first set of elements in the imagery received from the repository;

prioritize a second set of elements in infrared imagery received from the second electronic device; and

merge at least some of the first set of elements and at least some of the second set of elements based on the respective priorities of each element.

12. The first electronic device of claim 11, wherein the first set of elements include permanent objects, physical structures, or landmarks.

13. The first electronic device of claim 11, wherein the second set of elements include non-permanent type objects or objects captured in real-time.

14. The first electronic device of claim 8, wherein the second electronic device comprises one of a smart phone, tablet computer, wearable computer, or vehicle-based display.

15. The first electronic device of claim 8, wherein the first electronic device is configured in whole, or in part, as one of a smart phone, tablet computer, wearable computer, or vehicle-based navigation device.