Connecting wireless devices using visual image capture and processing

• US 9,332,578 B2
• Filed: 07/30/2014
• Issued: 05/03/2016
• Est. Priority Date: 07/30/2014
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Debates, Scott P., Forest, Francis W.
• Primary Examiner(s): Vuong, Quochien B
• Application Number:
  US14/446,673
• Publication Number:
  US 20160037563A1
• Time in Patent Office: 643 Days
• Field of Search: 455/41.1, 455/41.2, 455/41.3, 455/410, 455/411, 340/5.1, 340/5.2, 340/5.21, 340/5.61
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: H04L 2101/622 Layer-2 addresses, e.g. medium access control [MAC] addresses
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 76/10 Connection setup
• CPC Class Codes: H04W 8/005 Discovery of network devices, e.g. terminals

Abstract

A method facilitates establishment of wireless pairing connections between wireless electronic devices by: initiating, at a first device, a connection utility that enables the first device to establish a wireless connection with at least one second device; capturing an image of a selected second device, representing a second device to which a wireless connection is desired; and scanning for identifying information about each discoverable second device that is within a connection range of the first device. The method further includes: forwarding the captured image and any detected identifying information to a wireless connectivity assist (WCA) service; receiving wireless connection setup and configuration (WCSC) instructions from the WCA service; and establishing the wireless connection with the selected second device utilizing wireless connection setup and configuration (WCSC) instructions received from the WCA service.

Claims

1. A method for facilitating establishment of wireless pairing connections between wireless electronic devices, the method comprising:

initiating, at a first device, a connection utility that enables the first device to establish a wireless connection with at least one second device;

capturing an image of a selected second device, representing a second device to which a wireless connection is desired;

scanning for identifying information about each discoverable second device that is within a connection range of the first device;

forwarding the captured image and any detected identifying information to a wireless connectivity assist (WCA) service;

receiving wireless connection setup and configuration (WCSC) instructions from the WCA service; and

establishing the wireless connection with the selected second device utilizing the WCSC instructions received from the WCA service.

2. The method of claim 1, wherein the connection utility initiates a connection setup process and generates a prompt for a user to initiate image capture of the selected second device.

3. The method of claim 1, wherein scanning for information about each discoverable second device comprises:

retrieving and displaying detected identifying information on a display of the first electronic device; and

in response to receiving both the captured image and a user selection of a specific one of the identifying information;

associating the captured image with the selected identifying information and forwarding the association to the WCA service for processing; and

in response to a successful completion of the wireless connection following the user selection, forwarding a verification of the association to the WCA service to trigger an update of the WCA database.

4. The method of claim 1, wherein the detected identifying information comprises a machine identifier MAC ID of each detected second device and a corresponding received signal strength indicator (RSSI) of the MAC ID.

5. The method of claim 1, wherein establishing the wireless connection comprises:

initiating a timer for return of the WCSC instructions following the forwarding of the captured image and identifying information to the WCA service;

when the timer expires prior to receiving any WCSC instructions, displaying a notification that the connection requires a manual setup; and

when the WCSC instructions are received prior to expiration of the timer,

retrieving the instructions; and

implementing a series of setup steps identified in the instructions to establish the wireless connection.

6. The method of claim 5, further comprising:

when the WCSC instructions only includes instructions for manual setup and configuration, displaying the instructions on a display of the first device to enable a user to manually implement the setup of the wireless connection.

7. The method of claim 5, further comprising:

receiving from the WCA service a request for manual entry of additional details about the selected second device;

generating a prompt requesting user input of the other requested details; and

forwarding, to the WCA service, any other requested details received in response to the prompt, wherein the other requested details comprises at least one of a request for a different image of the selected second device, and a request for entry of device identifier information from one of a manufacturer, model number, serial number and type of device.

8. The method of claim 1, further comprising:

forwarding, to the WCA service, a notification indicating successful connection when the wireless connection is successfully established using the WCSC instructions; and

forwarding, to the WCA service, a notification indicating connection failure when the wireless connection is not successfully established using the WCSC instructions.

9. The method of claim 8, wherein prior to forwarding one of the first notification and the second notification, the method comprises:

displaying a prompt requesting a user indication of whether the received WCSC instructions facilitated a successful wireless connection with the selected second device; and

selecting from among the first notification and the second notification based on receipt of a corresponding first or second response to the prompt.

10. The method of claim 8, wherein the forwarding of the second notification further comprises:

prompting for entry of additional identifying information about the selected second device.

11. The method of claim 1, wherein the WCA service comprises a WCA utility executing within the first electronic device, and the method further comprises:

receiving the captured image and the identifying information;

comparing the captured image to a set of pre-stored images of second devices; and

in response to identifying a match of the captured image to at least one of the pre-stored images;

retrieving the WCSC instructions associated with the second device having the matching pre-stored image; and

forwarding the retrieved WCSC instructions to the wireless connection utility to complete the setup of the wireless connection with the selected second device.

12. The method of claim 11, further comprising:

in response to not finding a match of the captured image with the pre-stored images;

providing a first request for additional information about the selected second device; and

updating the database by adding the captured image to the pre-stored images; and

associating any additional information received in response to the first request with the stored captured image.

13. The method of claim 11, wherein retrieving the WCSC instructions comprises:

retrieving a MAC ID associated with the matching pre-stored image;

comparing the MAC ID against the detected identifying information; and

in response to identifying a match of the MAC ID with one detected MAC ID within the identifying information;

selecting a corresponding second device having the detected MAC ID; and

retrieving the WCSC instructions for that corresponding second device.

14. The method of claim 13, further comprising:

in response to not finding a manufacturer-provided MAC ID or name for the selected second device within the identifying information providing the WCSC information along with a request to place the selected second device in at least one of a powered-up mode and a MAC ID broadcast mode.

15. The method of claim 11, further comprising:

in response to not receiving a selection of a MAC ID with the captured image;

arranging a list of detected second devices in order based on retrieved RSSI values;

assigning a closest second device as the selected second device;

matching the MAC ID of the closest second device within the WCA database; and

providing WCSC instructions for the closest second device; and

in response to receiving a second notification indicating a failed connection, assigning a next closest second device as the selected second device and providing WCSC instructions for that next closest second device.

16. The method of claim 11, further comprising:

receiving one of a first notification of successful connection and a second notification of a failed connection from the connection utility; and

updating the WCA database based on a received notification, wherein when the first notification is received, the WCA utility increases a correlation score of the captured image to the MAC ID and the selected second device and when the second notification is received, the WCA utility changes a status of an association between the captured image and the selected second device to a recently failed status requiring new verification.

17. An electronic device comprising:

an image capturing device that captures an image of a second device;

at least one wireless communication component supporting establishment of one or more wireless connections with corresponding one or more second devices;

a modem that enables remote access to a wireless connection assist (WCA) service having an associated WCA database;

a processor communicatively coupled to the image capturing device, to the at least one wireless communication component, and to the modem and which executes a wireless connection utility that configures the electronic device to;

initiate a connection utility that enables the first device to establish a wireless connection with at least one second device;

in response to a received input for image capture, capture an image of a selected second device, representing a second device to which a wireless connection is desired;

scan for identifying information about each discoverable second device that is within a connection range of the first device;

forward the captured image and any detected identifying information to a wireless connectivity assist (WCA) service;

receive wireless connection setup and configuration (WCSC) instructions from the WCA service; and

establish the wireless connection with the selected second device utilizing WCSC instructions received from the WCA service.

18. The electronic device of claim 17, wherein the wireless connection utility further configures the electronic device to:

generate a prompt requesting the image capture of the selected second device;

retrieve and display detected identifying information on a display of the first electronic device; and

in response to receiving both the captured image and a user selection of a specific one of the identifying information;

associate the captured image with the selected identifying information and forward the association to the WCA service; and

in response to a successful completion of the wireless connection following the user selection, forward a verification of the association to the WCA service to trigger an update of the WCA database.

19. The electronic device of claim 18, wherein the WCA service comprises a WCA utility executing within the first electronic device, and which configures the electronic device to:

receive the captured image and the identifying information;

compare the captured image to a set of pre-stored images of second devices; and

in response to identifying a match of the captured image to at least one of the pre-stored images;

retrieve the WCSC instructions associated with the second device having the matching pre-stored image; and

forward the retrieved WCSC details to the wireless connection utility to complete the setup of the wireless connection with the selected second device.

20. The electronic device of claim 18, wherein the WCA utility further configures the electronic device to:

in response to not finding a match of the captured image with the pre-stored images;

provide a first request for additional information about the selected second device; and

update the database by;

adding the captured image to the pre-stored images; and

associating any additional information received in response to the first request with the stored captured image.

21. The electronic device of claim 18, wherein to retrieve the WCSC instructions, the WCA utility further configures the electronic device to:

first retrieve a MAC ID associated with the matching pre-stored image;

compare the MAC ID against the detected identifying information; and

in response to identifying a match of the MAC ID with one detected MAC ID within the identifying information;

select a corresponding second device having the detected MAC ID; and

retrieve the WCSC instructions for that corresponding second device.