Unitized, vision-controlled, wireless eyeglasses transceiver

• US 8,531,394 B2
• Filed: 02/24/2011
• Issued: 09/10/2013
• Est. Priority Date: 07/23/2010
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: TelepathEye, Inc.
• Inventors: Maltz, Gregory A.
• Primary Examiner(s): Beck, Alexander S
• Assistant Examiner(s): HERMANN, KIRK W
• Application Number:
  US13/034,182
• Publication Number:
  US 20120019645A1
• Time in Patent Office: 929 Days
• Field of Search: None
• US Class Current: 345/156
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 7/287 including a sight line detecting device
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

A device allowing a user to inconspicuously send and receive wireless messages, often short text messages, and transmit still images and/or video. The device may have an outward appearance resembling standard eyeglasses or sun glasses, and comprise a built in wireless transceiver, an optical display that enables the user to inconspicuously view incoming wireless text or e-mail messages, and an outwardly-facing image/video capturing device. The device allows the user to inconspicuously transmit outgoing messages, including still images and videos by a process in which the user simply moves his or her eyes and gazes at various display targets. The device'"'"'s eye tracking systems and software track the motion and gaze of the user'"'"'s eyes, and convert this gaze into message symbols and system control commands. The device is self-contained and operates, when placed on the user'"'"'s head, without the need for external battery packs.

Claims

1. A self-contained, head-mountable, vision-controlled device for wirelessly transmitting text, image, or video information to a selected recipient using only eve control, comprising:

a head-mountable frame configured to hold a lens in front of an eye of a user;

at least one eye-tracking sensor positioned to track movement of one or both eyes of the user;

an image capturing device positioned on said frame;

said image capturing device configured to capture either still images or video images (video) of the outside world;

a processor programmed to execute eye tracking executable code and control executable code, and to process images or video captured by the image capturing device;

an optical system configured to render a visual display viewable by the user, said optical system positioned in front of an eye of the user;

wherein said visual display displays at least one target for at least one symbol intended to select, using only eye control, said recipient when said eye of the user is directed toward said target, said target being positioned on a moving or rotating virtual surface;

and a wireless transceiver in communication with the processor, wherein the processor is programmed to;

track motion of an eye of the user using the eye-tracking sensor, process eye motion to determine whether the user desires to capture an image, and, if the eye motion alone indicates that the user desires to capture an image or video;

activate the image capturing device to capture an image or video, process the image or video, and transmit the image or video to a selected recipient using the wireless transceiver.

2. The device of claim 1, wherein said eye-tracking sensor comprises at least one near infrared light source and at least one video camera configured to detect near infrared light;

wherein said at least one near infrared light source is configured to shine near infrared electromagnetic radiation into at least one eye of said user; and

said at least one video camera is configured to focus on said at least one eye of said user.

3. The device of claim 1, wherein said optical system comprises a beam splitter and a converging lens or converging mirror.

4. The device of claim 1, wherein said visual display displays, as a target, at least one symbol for controlling said image capturing device to, using only eye gaze, capture still images, pictures, and/or motion video when said eye of the user is directed toward said target.

5. The device of claim 1, wherein said head-mounted frame has the appearance of an eyeglasses frame.

6. The device of claim 1, further comprising a light source for illuminating the image to be captured by the image capturing device.

7. The device of claim 1, wherein the visual display displays an e-mail or a text message received by the wireless transceiver.

8. The device of claim 1, wherein the visual display allows the user to create an e-mail or a text message using only eye control, and the processor transmits the e-mail or text message to a recipient using the wireless transceiver;

and

wherein the captured image or video can be attached to the e-mail message or the text message prior to transmission to the recipient.

17. The device of claim 1, wherein said device is configured to allow said user to select which said at least one symbol or command to use by gazing at a non-moving control target, in response to which said processor is configured to rotate or move said virtual surface, thus bringing into view various symbols or commands on said virtual surface that were not previously in view, thus allowing said user to then select the user desired symbols or commands by gazing at said user desired symbols or commands.

18. The device of claim 1, wherein said transceiver is selected from the group consisting of Bluetooth, Zigbee, WiFi, 0G, 1G, 2G, 3G, 4G, GSM, GPRS, CDMA, EV-DO, DECT-IS136/TDMA, iDEN, GSM EDGE 2-way-wireless-messaging FM transmissions, and a wireless communications modality that transmit signals beyond a radius of approximately 300 feet.

9. A self-contained, head-mountable, vision-controlled device for wirelessly transmitting text, image or video information to a selected recipient using only eve control, comprising:

a head-mountable frame configured to hold a lens in front of an eye of a user;

at least one eye-tracking sensor positioned to track movement of one or both eyes of the user;

an image capturing device positioned on said frame;

said image capturing device configured to capture either still images or video images (video) of the outside world;

a processor programmed to execute eye tracking executable code and control executable code, and to process images or video captured by the image capturing device;

an optical system configured to render a visual display viewable by the user, said optical system positioned in front of an eye of the user;

wherein said visual display displays at least one target for at least one symbol intended to select, using only eye control, said recipient when said eye of the user is directed toward said target, said target being positioned on a moving or rotating virtual surface with an axis of rotation that is spinning perpendicular to the eye gaze direction of the user;

wherein said processor, said eye tracking executable code, and said control executable code are configured to select said recipient by tracking the motion of said eye of said user via said at least one eye tracking sensor, translate the motion of said eye of said user into rotating or moving said virtual surface to display at least one symbol or command, selecting said at least one symbol or command, and constructing an email address, phone number, or other designation for said selected recipient;

wherein said processor, said eye tracking executable code, and said control executable code are configured to allow said user to select which said at least one symbol or command to use by gazing at a non-moving control target, in response to which said processor is configured to rotate or move said virtual surface, thus bringing into view various symbols or commands on said virtual surface that were not previously in view, thus allowing said user to then select the user desired symbols or commands by gazing at said user desired symbols or commands;

and a wireless transceiver in communication with the processor, wherein the processor is programmed to;

track motion of an eye of the user using the eye-tracking sensor, process eye motion to determine whether the user desires to capture video, and, if the eye motion alone indicates that the user desires to capture an image or video;

activate the image capturing device to capture images or video, process the image or video, and transmit the image or video to a selected recipient using the wireless transceiver.

10. The device of claim 9, wherein said eye-tracking sensor comprises at least one near infrared light source and at least one video camera configured to detect near infrared light;

wherein said at least one near infrared light source is configured to shine near infrared electromagnetic radiation into at least one eye of said user; and

said at least one video camera is configured to focus on said at least one eye of said user.

11. The device of claim 9, wherein said optical system comprises a beam splitter and a converging lens or converging mirror.

12. The device of claim 9, wherein said visual display displays, as a target, at least one symbol for controlling said video capturing device to, using only eye gaze, capture still images, pictures, and/or motion video when said eye of the user is directed toward said target.

13. The device of claim 9, wherein said head-mounted frame has the appearance of an eyeglasses frame.

14. The device of claim 9, further comprising a light source for illuminating a scene to be captured by the video capturing device.

15. The device of claim 9, wherein the visual display displays an e-mail or a text message received by the wireless transceiver.

16. The device of claim 9, wherein the visual display allows the user to create an e-mail or a text message and the processor transmits the e-mail or text message to a recipient using the wireless transceiver;

and

wherein an image or video clip captured by the video capture device can be attached to the e-mail message or the text message prior to transmission to the recipient.

19. The device of claim 9, wherein said transceiver is selected from the group consisting of Bluetooth, Zigbee, WiFi, 0G, 1G, 2G, 3G, 4G, GSM, GPRS, CDMA, EV-DO, DECT-IS136/TDMA, iDEN, GSM EDGE 2-way-wireless-messaging FM transmissions, and a wireless communications modality that transmit signals beyond a radius of approximately 300 feet.

20. The device of claim 9, wherein said device is configured to further display an eye gaze selectable list of recipient email addresses, telephone numbers, control elements, short phrases, alternative alphabets, or control commands on said rotating or moving virtual surface.

21. A self-contained, head-mountable, vision-controlled device for wirelessly transmitting text, image, or video information to a selected recipient using only eye control, comprising:

a head-mountable frame configured to hold a lens in front of an eye of a user;

at least one eye-tracking video camera positioned to track movement of one or both eyes of the user;

wherein said eye-tracking sensor comprises at least one near infrared light source and at least one video camera configured to detect near infrared light;

wherein said at least one near infrared light source is configured to shine near infrared electromagnetic radiation into at least one eye of said user; and

said at least one video camera is configured to focus on said at least one eye of said user;

an image capturing device positioned on said frame;

said image capturing device configured to capture either still images or video images (video) of the outside world;

a processor programmed to execute eye tracking executable code and control executable code, and to process images or video captured by the image capturing device;

an optical system configured to render a visual display viewable by the user, said optical system positioned in front of an eye of the user;

wherein said visual display displays, as a target, at least one symbol for controlling said image capturing device to, using only eye gaze, capture still images, pictures, and/or motion video when said eye of the user is directed toward said target;

and a wireless transceiver in communication with the processor, wherein the processor is programmed to;

track motion of an eye of the user using the eye-tracking sensor, process eye motion to determine whether the user desires to capture an image, and, if the eye motion alone indicates that the user desires to capture an image or video;

activate the image capturing device to capture an image or video, process the image or video, and transmit the image or video to a selected recipient using the wireless transceiver.